2024-04-15T23:21:08.171 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T23:21:08.171 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_teuthology@teuthology --name teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} --archive /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659 -- /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/orig.config.yaml 2024-04-15T23:21:08.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T23:21:08.285 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659 branch: squid description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7657659' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 461a84e6fbbf089011eafd13b98169fb9e9b8cc9 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 4286 sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 461a84e6fbbf089011eafd13b98169fb9e9b8cc9 targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLN/72GoCFriHKlyrdZVw/LdEz3dUx834w+2cx7NLTjKBrEAny5jo1VZjCXTQVczjIyQj4AOA8O4CKiRShUQUP4= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8e3tEe5X1UTLxmj184KS+lctC4v2gex0rXpKXUJRBdtcmBrNXDrQ7e5abae1crWzMM2UHTIjrNUET0OQwgP1A= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKJ/VR8YskKUNlKlpbgC+MoDBAX2u4amTrTWtQwffLPPh/IsGUxNqXxAVpHebJXumOEQvPg5atV+2C5TG3gLIXM= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXzIbTpoWupgp/B0wH0rH2O3cg7qAhRffdOCdtmffkpk4nUbuq/DrP1ZSYMFh7nztFVRyBxY4mtGqQ+mZ/hLhY= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsx.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-15_21:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-15T23:21:08.285 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa; will attempt to use it 2024-04-15T23:21:08.285 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks 2024-04-15T23:21:08.286 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-15T23:21:08.290 INFO:teuthology.task.internal:Checking packages... 2024-04-15T23:21:08.315 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a9a752df26c63acad72e1b3569fd79a515ca0765' 2024-04-15T23:21:08.315 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-15T23:21:08.315 INFO:teuthology.packaging:ref: None 2024-04-15T23:21:08.315 INFO:teuthology.packaging:tag: None 2024-04-15T23:21:08.315 INFO:teuthology.packaging:branch: squid 2024-04-15T23:21:08.315 INFO:teuthology.packaging:sha1: a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:21:08.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-15T23:21:08.479 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2114.ga9a752df 2024-04-15T23:21:08.481 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-15T23:21:08.487 INFO:teuthology.task.internal:no buildpackages task found 2024-04-15T23:21:08.487 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-15T23:21:08.495 INFO:teuthology.task.internal:Saving configuration 2024-04-15T23:21:08.508 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-15T23:21:08.514 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T23:21:08.539 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.727841', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLN/72GoCFriHKlyrdZVw/LdEz3dUx834w+2cx7NLTjKBrEAny5jo1VZjCXTQVczjIyQj4AOA8O4CKiRShUQUP4='} 2024-04-15T23:21:08.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.729191', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8e3tEe5X1UTLxmj184KS+lctC4v2gex0rXpKXUJRBdtcmBrNXDrQ7e5abae1crWzMM2UHTIjrNUET0OQwgP1A='} 2024-04-15T23:21:08.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.731614', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKJ/VR8YskKUNlKlpbgC+MoDBAX2u4amTrTWtQwffLPPh/IsGUxNqXxAVpHebJXumOEQvPg5atV+2C5TG3gLIXM='} 2024-04-15T23:21:08.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.730406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXzIbTpoWupgp/B0wH0rH2O3cg7qAhRffdOCdtmffkpk4nUbuq/DrP1ZSYMFh7nztFVRyBxY4mtGqQ+mZ/hLhY='} 2024-04-15T23:21:08.609 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-15T23:21:08.615 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-15T23:21:08.615 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['osd.0'] 2024-04-15T23:21:08.615 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['osd.1'] 2024-04-15T23:21:08.615 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['osd.2'] 2024-04-15T23:21:08.615 INFO:teuthology.run_tasks:Running task console_log... 2024-04-15T23:21:08.751 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f7a4b10d0>, signals=[15]) 2024-04-15T23:21:08.751 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-15T23:21:08.759 INFO:teuthology.task.internal:Opening connections... 2024-04-15T23:21:08.760 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-04-15T23:21:08.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:21:08.891 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-04-15T23:21:08.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:21:09.025 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:21:09.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:21:09.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:21:09.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:21:09.209 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-15T23:21:09.217 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-04-15T23:21:09.234 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-04-15T23:21:09.234 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-04-15T23:21:09.290 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-04-15T23:21:09.290 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-04-15T23:21:09.290 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-04-15T23:21:09.290 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-04-15T23:21:09.290 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T23:21:09.291 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T23:21:09.292 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-04-15T23:21:09.327 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-04-15T23:21:09.345 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-04-15T23:21:09.345 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-15T23:21:09.402 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-04-15T23:21:09.402 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T23:21:09.403 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T23:21:09.404 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-15T23:21:09.427 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-04-15T23:21:09.445 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-04-15T23:21:09.445 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-15T23:21:09.502 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-15T23:21:09.502 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-04-15T23:21:09.502 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T23:21:09.503 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T23:21:09.503 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-15T23:21:09.526 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-04-15T23:21:09.545 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-04-15T23:21:09.545 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-04-15T23:21:09.602 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T23:21:09.603 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T23:21:09.604 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T23:21:09.604 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-04-15T23:21:09.626 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-15T23:21:09.636 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-15T23:21:09.663 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-15T23:21:09.663 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-04-15T23:21:09.665 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-04-15T23:21:09.668 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-04-15T23:21:09.670 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-04-15T23:21:09.686 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-15T23:21:09.692 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-15T23:21:09.693 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-04-15T23:21:09.721 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-04-15T23:21:09.724 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-04-15T23:21:09.726 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-04-15T23:21:09.843 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-15T23:21:09.940 INFO:teuthology.run_tasks:Running task kernel... 2024-04-15T23:21:09.954 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-15T23:21:09.954 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-15T23:21:09.955 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T23:21:09.955 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T23:21:09.956 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T23:21:09.956 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-15T23:21:09.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:21:09.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:21:09.973 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-15T23:21:09.973 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-04-15T23:21:09.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:21:09.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:21:09.975 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-15T23:21:09.975 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-04-15T23:21:10.030 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-361.el9.x86_64 2024-04-15T23:21:10.030 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-361.el9.x86_64 2024-04-15T23:21:10.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-04-15T23:21:10.031 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-361.el9.x86_64 2024-04-15T23:21:10.031 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.14.0-361.el9.x86_64 2024-04-15T23:21:10.031 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2024-04-15T23:21:10.032 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-361.el9.x86_64 2024-04-15T23:21:10.033 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-361.el9.x86_64 2024-04-15T23:21:10.033 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-04-15T23:21:10.034 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-361.el9.x86_64 2024-04-15T23:21:10.034 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-361.el9.x86_64 2024-04-15T23:21:10.034 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-04-15T23:21:12.184 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-15T23:21:12.185 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-15T23:21:12.301 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-15T23:21:12.316 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-04-15T23:21:13.644 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-04-15T23:21:13.700 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-04-15T23:21:14.200 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2024-04-15T23:21:14.268 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - BaseOS 2.3 MB/s | 2.0 MB 00:00 2024-04-15T23:21:14.891 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-04-15T23:21:15.117 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-15T23:21:15.420 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-04-15T23:21:17.282 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.0 MB 00:02 2024-04-15T23:21:17.359 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-15T23:21:17.610 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-15T23:21:20.525 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 19 MB 00:04 2024-04-15T23:21:21.694 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-15T23:21:22.457 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 19 MB 00:04 2024-04-15T23:21:23.536 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-04-15T23:21:24.488 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 26 MB/s | 21 MB 00:00 2024-04-15T23:21:24.851 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.2 MB 00:03 2024-04-15T23:21:24.878 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.2 MB 00:00 2024-04-15T23:21:26.519 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-15T23:21:26.544 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-04-15T23:21:27.375 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-04-15T23:21:28.038 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-15T23:21:28.900 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-04-15T23:21:29.566 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-15T23:21:30.404 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-15T23:21:31.894 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T23:21:31.894 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T23:21:31.993 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-15T23:21:32.010 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-15T23:21:32.010 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-15T23:21:32.010 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-15T23:21:32.010 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-15T23:21:32.010 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T23:21:32.010 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 77 M 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 123 M 2024-04-15T23:21:32.011 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-15T23:21:32.180 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.6 MB/s | 277 kB 00:00 2024-04-15T23:21:32.614 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 25 MB/s | 15 MB 00:00 2024-04-15T23:21:32.985 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-04-15T23:21:33.222 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 21 MB 00:06 2024-04-15T23:21:33.538 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 22 MB/s | 34 MB 00:01 2024-04-15T23:21:34.014 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 15 MB/s | 28 MB 00:01 2024-04-15T23:21:34.016 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:21:34.016 INFO:teuthology.orchestra.run.smithi115.stdout:Total 38 MB/s | 77 MB 00:02 2024-04-15T23:21:34.017 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-15T23:21:34.388 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-15T23:21:34.388 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-15T23:21:35.219 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-15T23:21:35.219 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-15T23:21:35.367 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T23:21:35.367 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T23:21:35.451 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-15T23:21:35.459 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-15T23:21:35.466 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-04-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:21:35.468 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 77 M 2024-04-15T23:21:35.468 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 123 M 2024-04-15T23:21:35.468 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-15T23:21:35.628 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.7 MB/s | 277 kB 00:00 2024-04-15T23:21:36.195 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 21 MB/s | 15 MB 00:00 2024-04-15T23:21:36.604 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 30 MB/s | 34 MB 00:01 2024-04-15T23:21:37.062 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 19 MB/s | 28 MB 00:01 2024-04-15T23:21:37.065 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:21:37.065 INFO:teuthology.orchestra.run.smithi107.stdout:Total 48 MB/s | 77 MB 00:01 2024-04-15T23:21:37.065 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-15T23:21:37.439 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-15T23:21:37.439 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-15T23:21:37.560 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-15T23:21:37.825 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T23:21:37.825 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T23:21:37.963 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-04-15T23:21:37.980 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:21:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 77 M 2024-04-15T23:21:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 123 M 2024-04-15T23:21:37.981 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-15T23:21:38.128 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.8 MB/s | 277 kB 00:00 2024-04-15T23:21:38.193 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:21:38.278 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-15T23:21:38.278 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-15T23:21:38.280 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:38.369 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-04-15T23:21:38.786 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-04-15T23:21:39.361 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 24 MB/s | 34 MB 00:01 2024-04-15T23:21:39.695 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 18 MB/s | 28 MB 00:01 2024-04-15T23:21:39.698 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:21:39.698 INFO:teuthology.orchestra.run.smithi195.stdout:Total 45 MB/s | 77 MB 00:01 2024-04-15T23:21:39.699 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-15T23:21:40.054 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-15T23:21:40.474 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-15T23:21:40.577 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-15T23:21:40.760 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-15T23:21:40.760 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-15T23:21:40.855 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-15T23:21:40.867 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-15T23:21:40.868 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-04-15T23:21:40.869 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-04-15T23:21:40.869 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:21:40.869 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 77 M 2024-04-15T23:21:40.869 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 123 M 2024-04-15T23:21:40.869 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-15T23:21:40.877 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-15T23:21:40.878 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-15T23:21:41.020 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.8 MB/s | 277 kB 00:00 2024-04-15T23:21:41.046 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:21:41.199 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:41.254 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:41.612 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 20 MB/s | 15 MB 00:00 2024-04-15T23:21:42.089 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 28 MB/s | 34 MB 00:01 2024-04-15T23:21:42.413 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 20 MB/s | 28 MB 00:01 2024-04-15T23:21:42.416 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:21:42.416 INFO:teuthology.orchestra.run.smithi102.stdout:Total 50 MB/s | 77 MB 00:01 2024-04-15T23:21:42.416 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-15T23:21:42.773 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-15T23:21:42.773 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-15T23:21:43.163 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-15T23:21:43.642 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-15T23:21:43.642 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-15T23:21:43.858 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:21:43.945 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:44.156 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:45.921 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:45.943 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-15T23:21:45.958 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:46.542 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:21:46.631 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:46.714 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:46.847 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:48.870 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:48.905 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:49.372 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:21:49.510 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:50.713 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:51.552 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:51.598 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:53.621 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:54.201 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:21:54.401 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:56.470 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:21:59.081 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:20.290 INFO:teuthology.orchestra.run.smithi115.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T23:22:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:22:20.333 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:20.739 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:20.739 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:22:20.739 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:22:20.739 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:21.166 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:22:21.167 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-15T23:22:21.477 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:21.618 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:21.619 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:21.619 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T23:22:21.619 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T23:22:21.619 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T23:22:21.619 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-15T23:22:21.619 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T23:22:21.620 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:21.699 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:21.699 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:21.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.06 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 68.el9 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Group : Unspecified 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 8264254 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T23:22:21.742 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : builder@centos.org 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:22:21.743 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T23:22:21.746 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T23:22:21.746 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 5.14.0-438.el9.x86_64 2024-04-15T23:22:21.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T23:22:22.383 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-04-15T23:22:22.989 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:22.990 INFO:teuthology.orchestra.run.smithi107.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T23:22:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:22:23.034 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:22:23.659 INFO:teuthology.orchestra.run.smithi115.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T23:22:23.696 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-04-15T23:22:23.699 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-04-15T23:22:23.714 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.QC5FymEcQB 2024-04-15T23:22:23.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QC5FymEcQB 2024-04-15T23:22:23.783 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.QC5FymEcQB 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:22:23.847 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-15T23:22:23.926 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.QC5FymEcQB is 6KB 2024-04-15T23:22:23.974 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.QC5FymEcQB 2024-04-15T23:22:23.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T23:22:24.053 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T23:22:24.053 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T23:22:24.053 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T23:22:24.053 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T23:22:24.054 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T23:22:24.182 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:24.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-04-15T23:22:24.284 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:24.285 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:24.285 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T23:22:24.285 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T23:22:24.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T23:22:24.285 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-15T23:22:24.285 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T23:22:24.285 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:24.366 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:24.366 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:24.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-04-15T23:22:24.410 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-04-15T23:22:24.410 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-04-15T23:22:24.410 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-04-15T23:22:24.410 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2024-04-15T23:22:24.410 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:22:24.411 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T23:22:24.412 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T23:22:24.412 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T23:22:24.412 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-04-15T23:22:24.412 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:22:24.412 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T23:22:24.413 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T23:22:24.414 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-438.el9.x86_64 2024-04-15T23:22:24.414 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T23:22:24.999 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-04-15T23:22:25.879 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:25.880 INFO:teuthology.orchestra.run.smithi195.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T23:22:25.880 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:22:25.922 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:26.274 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:26.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:22:26.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:22:26.274 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:22:26.358 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T23:22:26.377 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-04-15T23:22:26.380 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-04-15T23:22:26.395 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.mqD6yDqqSs 2024-04-15T23:22:26.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mqD6yDqqSs 2024-04-15T23:22:26.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.mqD6yDqqSs 2024-04-15T23:22:26.598 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.mqD6yDqqSs is 6KB 2024-04-15T23:22:26.617 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.mqD6yDqqSs 2024-04-15T23:22:26.631 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T23:22:26.696 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T23:22:26.696 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T23:22:26.696 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T23:22:26.697 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T23:22:26.698 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T23:22:26.707 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:26.707 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:22:26.708 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-15T23:22:26.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-04-15T23:22:27.032 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:27.127 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:27.128 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:27.128 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T23:22:27.128 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T23:22:27.128 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T23:22:27.128 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-15T23:22:27.128 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T23:22:27.128 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:27.208 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:27.209 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:27.209 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 68.el9 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2024-04-15T23:22:27.246 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8264254 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-04-15T23:22:27.247 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:22:27.248 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T23:22:27.249 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T23:22:27.249 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 5.14.0-438.el9.x86_64 2024-04-15T23:22:27.249 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T23:22:27.855 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-04-15T23:22:28.351 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:28.352 INFO:teuthology.orchestra.run.smithi102.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-15T23:22:28.352 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:22:28.395 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:28.789 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:28.789 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-15T23:22:28.789 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-15T23:22:28.789 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-15T23:22:29.222 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:22:29.223 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-15T23:22:29.276 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T23:22:29.296 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-04-15T23:22:29.298 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-04-15T23:22:29.314 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.gMt1xNMPUH 2024-04-15T23:22:29.314 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gMt1xNMPUH 2024-04-15T23:22:29.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.gMt1xNMPUH 2024-04-15T23:22:29.527 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.gMt1xNMPUH is 6KB 2024-04-15T23:22:29.576 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.gMt1xNMPUH 2024-04-15T23:22:29.591 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T23:22:29.598 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:29.655 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T23:22:29.656 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T23:22:29.656 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T23:22:29.656 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T23:22:29.657 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.692 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.692 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:29.693 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-15T23:22:29.693 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-15T23:22:29.693 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-15T23:22:29.693 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-15T23:22:29.693 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-04-15T23:22:29.693 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-04-15T23:22:29.774 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-15T23:22:29.774 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-15T23:22:29.774 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-04-15T23:22:29.814 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-04-15T23:22:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-04-15T23:22:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-04-15T23:22:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-04-15T23:22:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 68.el9 2024-04-15T23:22:29.818 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8264254 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:22:29.819 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-15T23:22:29.820 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-15T23:22:29.820 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-15T23:22:29.820 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-04-15T23:22:29.820 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:22:29.820 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-04-15T23:22:29.821 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-15T23:22:29.821 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-438.el9.x86_64 2024-04-15T23:22:29.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-15T23:22:30.382 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-04-15T23:22:31.805 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-15T23:22:31.828 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-04-15T23:22:31.830 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-15T23:22:31.845 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.4GEkJ6dzXh 2024-04-15T23:22:31.846 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4GEkJ6dzXh 2024-04-15T23:22:31.922 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.4GEkJ6dzXh 2024-04-15T23:22:32.060 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.4GEkJ6dzXh is 6KB 2024-04-15T23:22:32.108 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.4GEkJ6dzXh 2024-04-15T23:22:32.122 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-04-15T23:22:32.193 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-15T23:22:32.194 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-15T23:22:32.194 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-15T23:22:32.194 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-15T23:22:32.195 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-15T23:22:32.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-04-15T23:22:54.226 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-15T23:22:54.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:22:54.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:22:56.849 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-15T23:22:56.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-15T23:22:56.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:22:59.818 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-15T23:22:59.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:22:59.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:02.373 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-15T23:23:02.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-15T23:23:02.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:18.175 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-15T23:23:27.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:23:27.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:28.670 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-15T23:23:30.238 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-04-15T23:23:31.487 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-15T23:23:36.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-04-15T23:23:37.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:23:37.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:40.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-15T23:23:40.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:42.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:23:42.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:45.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-15T23:23:45.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:23:56.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-15T23:23:58.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-15T23:24:04.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-04-15T23:24:08.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:24:08.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:24:10.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-15T23:24:10.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:24:11.138 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-15T23:24:14.147 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-15T23:24:14.285 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-15T23:24:14.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:24:14.613 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.14.0-438.el9.x86_64"... 2024-04-15T23:24:14.613 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-04-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-438.el9.x86_64 2024-04-15T23:24:14.628 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T23:24:14.628 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T23:24:14.628 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T23:24:14.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-15T23:24:14.773 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.14.0-438.el9.x86_64"... 2024-04-15T23:24:14.773 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-04-15T23:24:14.788 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-438.el9.x86_64 2024-04-15T23:24:14.788 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T23:24:14.788 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T23:24:14.788 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T23:24:15.630 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-15T23:24:15.630 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T23:24:15.705 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-04-15T23:24:15.739 DEBUG:teuthology.parallel:result is None 2024-04-15T23:24:15.789 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-15T23:24:15.790 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T23:24:15.879 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-04-15T23:24:15.913 DEBUG:teuthology.parallel:result is None 2024-04-15T23:24:16.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-15T23:24:16.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:24:16.586 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-04-15T23:24:17.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-15T23:24:17.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-15T23:24:17.017 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-04-15T23:24:17.032 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-438.el9.x86_64 2024-04-15T23:24:17.032 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T23:24:17.032 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T23:24:17.032 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T23:24:18.032 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-15T23:24:18.033 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T23:24:18.106 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-04-15T23:24:18.154 DEBUG:teuthology.parallel:result is None 2024-04-15T23:24:26.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:24:26.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:24:26.532 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-15T23:24:26.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:24:26.958 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.14.0-438.el9.x86_64"... 2024-04-15T23:24:26.958 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-15T23:24:26.974 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-438.el9.x86_64 2024-04-15T23:24:26.974 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-15T23:24:26.974 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-15T23:24:26.974 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-15T23:24:27.975 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-15T23:24:27.976 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-15T23:24:28.059 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-04-15T23:24:28.092 DEBUG:teuthology.parallel:result is None 2024-04-15T23:24:28.092 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-15T23:24:28.101 INFO:teuthology.task.internal:Creating test directory... 2024-04-15T23:24:28.101 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T23:24:28.104 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T23:24:28.107 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T23:24:28.109 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-15T23:24:28.128 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-15T23:24:28.134 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-15T23:24:28.141 INFO:teuthology.task.internal:Creating archive directory... 2024-04-15T23:24:28.141 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T23:24:28.163 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T23:24:28.166 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T23:24:28.168 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-15T23:24:28.266 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-15T23:24:28.273 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-15T23:24:28.273 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T23:24:28.275 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T23:24:28.278 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T23:24:28.280 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-15T23:24:28.307 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.311 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.318 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.322 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.322 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.326 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.333 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.337 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-15T23:24:28.339 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-15T23:24:28.346 INFO:teuthology.task.internal:Configuring sudo... 2024-04-15T23:24:28.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T23:24:28.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T23:24:28.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T23:24:28.377 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-15T23:24:28.411 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-15T23:24:28.421 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-15T23:24:28.421 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T23:24:28.437 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T23:24:28.444 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T23:24:28.448 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-15T23:24:28.468 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:28.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:28.584 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:28.667 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:28.712 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:24:28.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T23:24:28.782 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:28.827 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:28.885 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:28.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:29.017 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:24:29.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T23:24:29.087 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:29.133 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:29.194 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:29.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:29.284 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:24:29.284 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T23:24:29.354 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:29.400 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-15T23:24:29.469 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:29.510 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-15T23:24:29.560 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:24:29.560 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-15T23:24:29.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-04-15T23:24:29.634 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-04-15T23:24:29.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-04-15T23:24:29.639 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-04-15T23:24:29.678 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:24:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:24:29.701 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:24:29.720 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:24:30.203 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-15T23:24:30.211 INFO:teuthology.task.internal:Starting timer... 2024-04-15T23:24:30.212 INFO:teuthology.run_tasks:Running task pcp... 2024-04-15T23:24:30.231 INFO:teuthology.run_tasks:Running task selinux... 2024-04-15T23:24:30.243 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-15T23:24:30.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-04-15T23:24:30.299 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-04-15T23:24:30.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-04-15T23:24:30.373 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-04-15T23:24:30.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-04-15T23:24:30.433 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-04-15T23:24:30.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-04-15T23:24:30.495 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-04-15T23:24:30.497 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-15T23:24:30.497 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-04-15T23:24:30.519 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-04-15T23:24:30.520 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-04-15T23:24:30.550 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-04-15T23:24:30.551 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-04-15T23:24:30.575 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-04-15T23:24:30.576 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-04-15T23:24:30.598 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-04-15T23:24:30.598 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-04-15T23:24:30.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:24:30.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:24:30.629 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:24:30.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:24:30.663 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:24:30.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:24:30.694 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:24:30.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:24:30.724 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-15T23:24:30.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-04-15T23:24:30.755 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-04-15T23:24:30.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-04-15T23:24:30.827 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-04-15T23:24:30.870 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-15T23:24:30.880 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-15T23:24:30.886 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-15T23:24:31.011 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-15T23:24:31.027 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-15T23:24:31.028 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi107.front.sepia.ceph.com,smithi115.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-15T23:28:54.006 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-04-15T23:28:54.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-15T23:28:54.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:28:54.099 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-04-15T23:28:54.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-04-15T23:28:54.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-15T23:28:54.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:28:54.272 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-15T23:28:54.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-15T23:28:54.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:28:54.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:28:54.446 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-15T23:28:54.531 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:28:54.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:28:54.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:28:54.626 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-15T23:28:54.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:28:54.714 INFO:teuthology.run_tasks:Running task clock... 2024-04-15T23:28:54.724 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-15T23:28:54.724 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T23:28:54.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:28:54.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T23:28:54.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:28:54.730 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T23:28:54.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:28:54.732 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-15T23:28:54.732 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:28:54.761 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T23:28:54.764 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T23:28:54.765 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T23:28:54.780 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T23:28:54.782 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T23:28:54.784 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T23:28:54.787 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-15T23:28:54.806 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-15T23:28:54.812 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-04-15T23:28:54.813 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-04-15T23:28:54.816 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-04-15T23:28:54.827 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-04-15T23:28:54.828 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-04-15T23:28:54.832 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-04-15T23:28:54.838 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-04-15T23:28:54.845 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T23:28:54.846 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T23:28:54.849 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T23:28:54.852 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-04-15T23:28:54.863 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T23:28:54.863 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T23:28:54.867 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T23:28:54.870 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-15T23:28:54.888 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-15T23:28:54.916 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:28:54.916 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:28:54.918 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:28:54.918 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-04-15T23:28:54.918 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.919 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.919 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.919 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.920 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:28:54.920 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-04-15T23:28:54.920 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.920 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.921 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.921 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.921 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:28:54.924 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:28:54.924 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-04-15T23:28:54.924 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.924 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.924 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.924 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.942 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:28:54.945 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:28:54.945 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-15T23:28:54.945 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.945 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.946 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.946 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:28:54.946 INFO:teuthology.run_tasks:Running task install... 2024-04-15T23:28:54.954 DEBUG:teuthology.task.install:project ceph 2024-04-15T23:28:54.954 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}} 2024-04-15T23:28:54.954 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'} 2024-04-15T23:28:54.955 INFO:teuthology.task.install:Using flavor: default 2024-04-15T23:28:54.962 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-15T23:28:54.962 INFO:teuthology.task.install:extra packages: [] 2024-04-15T23:28:54.962 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-15T23:28:54.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:28:54.965 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-15T23:28:54.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:28:54.966 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-15T23:28:54.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:28:54.967 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'tag': None, 'wait_for_package': False} 2024-04-15T23:28:54.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:28:55.115 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-15T23:28:55.115 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-15T23:28:55.118 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-15T23:28:55.118 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-15T23:28:55.181 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-15T23:28:55.181 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-15T23:28:55.195 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/ 2024-04-15T23:28:55.196 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2114.ga9a752df 2024-04-15T23:28:55.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T23:28:55.236 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:28:55.236 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T23:28:55.273 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-15T23:28:55.273 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T23:28:55.288 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T23:28:55.288 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:28:55.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T23:28:55.291 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T23:28:55.291 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:28:55.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T23:28:55.321 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-15T23:28:55.321 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T23:28:55.322 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-15T23:28:55.323 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T23:28:55.343 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T23:28:55.367 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/a9a752df26c63acad72e1b3569fd79a515ca0765/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-15T23:28:55.367 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:28:55.367 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-15T23:28:55.390 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T23:28:55.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T23:28:55.398 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-04-15T23:28:55.398 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a9a752df26c63acad72e1b3569fd79a515ca0765/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-15T23:28:55.425 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T23:28:55.469 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-15T23:28:55.473 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T23:28:55.477 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T23:28:55.492 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-04-15T23:28:55.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-04-15T23:28:55.540 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-04-15T23:28:55.542 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-04-15T23:28:55.545 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-04-15T23:28:55.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-04-15T23:28:55.552 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-15T23:28:55.620 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-04-15T23:28:55.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-04-15T23:28:55.737 INFO:teuthology.orchestra.run.smithi195.stdout:74 files removed 2024-04-15T23:28:55.765 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-15T23:28:55.782 INFO:teuthology.orchestra.run.smithi107.stdout:74 files removed 2024-04-15T23:28:55.806 INFO:teuthology.orchestra.run.smithi115.stdout:74 files removed 2024-04-15T23:28:55.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-15T23:28:55.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-15T23:28:55.870 INFO:teuthology.orchestra.run.smithi102.stdout:74 files removed 2024-04-15T23:28:55.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-04-15T23:28:56.446 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 220 kB/s | 83 kB 00:00 2024-04-15T23:28:56.512 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 207 kB/s | 83 kB 00:00 2024-04-15T23:28:56.565 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 227 kB/s | 83 kB 00:00 2024-04-15T23:28:56.569 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 194 kB/s | 83 kB 00:00 2024-04-15T23:28:56.880 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-04-15T23:28:56.937 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-04-15T23:28:56.966 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-15T23:28:56.982 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-15T23:28:57.389 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-04-15T23:28:57.454 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-04-15T23:28:57.483 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-04-15T23:28:57.512 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-04-15T23:28:57.991 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-04-15T23:28:58.036 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-15T23:28:58.233 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.7 MB 00:00 2024-04-15T23:28:58.240 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - AppStream 9.0 MB/s | 6.7 MB 00:00 2024-04-15T23:28:59.553 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2024-04-15T23:28:59.575 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2024-04-15T23:28:59.657 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-04-15T23:28:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-04-15T23:29:00.782 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-15T23:29:00.998 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 8.0 MB/s | 8.0 MB 00:01 2024-04-15T23:29:01.068 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.0 MB 00:01 2024-04-15T23:29:01.142 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-04-15T23:29:02.883 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-15T23:29:04.103 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 19 MB 00:01 2024-04-15T23:29:07.050 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-04-15T23:29:08.253 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-04-15T23:29:08.910 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-04-15T23:29:09.754 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-15T23:29:10.605 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-15T23:29:10.858 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-15T23:29:15.726 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-15T23:29:15.965 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-15T23:29:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:18.432 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:18.454 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:16 2024-04-15T23:29:18.518 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-15T23:29:18.540 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2024-04-15T23:29:18.540 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-15T23:29:18.540 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2024-04-15T23:29:18.540 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-15T23:29:18.540 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-15T23:29:18.541 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-15T23:29:18.542 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-15T23:29:18.543 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-15T23:29:18.544 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T23:29:18.545 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T23:29:18.546 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-15T23:29:18.547 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T23:29:18.548 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T23:29:18.549 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T23:29:18.550 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-15T23:29:18.551 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T23:29:18.552 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T23:29:18.553 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-15T23:29:18.554 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================================ 2024-04-15T23:29:18.555 INFO:teuthology.orchestra.run.smithi115.stdout:Install 137 Packages 2024-04-15T23:29:18.555 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 16 Packages 2024-04-15T23:29:18.555 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:29:18.555 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 212 M 2024-04-15T23:29:18.556 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-15T23:29:18.670 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:18.671 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:18.756 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-04-15T23:29:18.766 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-04-15T23:29:18.766 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-04-15T23:29:18.766 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-04-15T23:29:18.766 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-15T23:29:18.767 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-15T23:29:18.768 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-15T23:29:18.769 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-15T23:29:18.770 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T23:29:18.771 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T23:29:18.772 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T23:29:18.773 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T23:29:18.774 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T23:29:18.775 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T23:29:18.775 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T23:29:18.775 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T23:29:18.775 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T23:29:18.775 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T23:29:18.775 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T23:29:18.776 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T23:29:18.777 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================================ 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout:Install 137 Packages 2024-04-15T23:29:18.778 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 16 Packages 2024-04-15T23:29:18.779 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:29:18.779 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 212 M 2024-04-15T23:29:18.779 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-04-15T23:29:19.377 INFO:teuthology.orchestra.run.smithi115.stdout:(1/153): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 40 kB/s | 6.6 kB 00:00 2024-04-15T23:29:19.549 INFO:teuthology.orchestra.run.smithi102.stdout:(1/153): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 28 kB/s | 6.6 kB 00:00 2024-04-15T23:29:19.594 INFO:teuthology.orchestra.run.smithi115.stdout:(2/153): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 4.0 MB/s | 891 kB 00:00 2024-04-15T23:29:19.653 INFO:teuthology.orchestra.run.smithi115.stdout:(3/153): ceph-immutable-object-cache-19.0.0-211 2.4 MB/s | 145 kB 00:00 2024-04-15T23:29:20.136 INFO:teuthology.orchestra.run.smithi115.stdout:(4/153): ceph-base-19.0.0-2114.ga9a752df.el7.x8 5.8 MB/s | 5.3 MB 00:00 2024-04-15T23:29:20.174 INFO:teuthology.orchestra.run.smithi102.stdout:(2/153): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 1.4 MB/s | 891 kB 00:00 2024-04-15T23:29:20.186 INFO:teuthology.orchestra.run.smithi115.stdout:(5/153): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 4.4 MB/s | 2.4 MB 00:00 2024-04-15T23:29:20.249 INFO:teuthology.orchestra.run.smithi102.stdout:(3/153): ceph-base-19.0.0-2114.ga9a752df.el7.x8 5.7 MB/s | 5.3 MB 00:00 2024-04-15T23:29:20.325 INFO:teuthology.orchestra.run.smithi102.stdout:(4/153): ceph-immutable-object-cache-19.0.0-211 965 kB/s | 145 kB 00:00 2024-04-15T23:29:20.328 INFO:teuthology.orchestra.run.smithi115.stdout:(6/153): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 7.8 MB/s | 1.5 MB 00:00 2024-04-15T23:29:20.641 INFO:teuthology.orchestra.run.smithi102.stdout:(5/153): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 6.0 MB/s | 2.4 MB 00:00 2024-04-15T23:29:20.954 INFO:teuthology.orchestra.run.smithi115.stdout:(7/153): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 6.1 MB/s | 4.7 MB 00:00 2024-04-15T23:29:21.250 INFO:teuthology.orchestra.run.smithi102.stdout:(6/153): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 1.6 MB/s | 1.5 MB 00:00 2024-04-15T23:29:21.376 INFO:teuthology.orchestra.run.smithi102.stdout:(7/153): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 6.4 MB/s | 4.7 MB 00:00 2024-04-15T23:29:22.663 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.2 MB 00:00 2024-04-15T23:29:22.954 INFO:teuthology.orchestra.run.smithi115.stdout:(8/153): ceph-osd-19.0.0-2114.ga9a752df.el7.x86 6.4 MB/s | 17 MB 00:02 2024-04-15T23:29:22.958 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 934 kB/s | 19 MB 00:20 2024-04-15T23:29:23.004 INFO:teuthology.orchestra.run.smithi115.stdout:(9/153): ceph-selinux-19.0.0-2114.ga9a752df.el7 506 kB/s | 25 kB 00:00 2024-04-15T23:29:23.168 INFO:teuthology.orchestra.run.smithi102.stdout:(8/153): ceph-common-19.0.0-2114.ga9a752df.el7. 5.4 MB/s | 21 MB 00:03 2024-04-15T23:29:23.285 INFO:teuthology.orchestra.run.smithi102.stdout:(9/153): ceph-radosgw-19.0.0-2114.ga9a752df.el7 5.2 MB/s | 9.9 MB 00:01 2024-04-15T23:29:23.310 INFO:teuthology.orchestra.run.smithi102.stdout:(10/153): ceph-selinux-19.0.0-2114.ga9a752df.el 178 kB/s | 25 kB 00:00 2024-04-15T23:29:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:(11/153): libcephfs-devel-19.0.0-2114.ga9a752df 381 kB/s | 32 kB 00:00 2024-04-15T23:29:23.454 INFO:teuthology.orchestra.run.smithi115.stdout:(10/153): ceph-radosgw-19.0.0-2114.ga9a752df.el 3.9 MB/s | 9.9 MB 00:02 2024-04-15T23:29:23.544 INFO:teuthology.orchestra.run.smithi102.stdout:(12/153): libcephfs2-19.0.0-2114.ga9a752df.el7. 4.9 MB/s | 746 kB 00:00 2024-04-15T23:29:23.546 INFO:teuthology.orchestra.run.smithi115.stdout:(11/153): libcephfs-devel-19.0.0-2114.ga9a752df 347 kB/s | 32 kB 00:00 2024-04-15T23:29:23.619 INFO:teuthology.orchestra.run.smithi102.stdout:(13/153): libcephsqlite-19.0.0-2114.ga9a752df.e 2.1 MB/s | 164 kB 00:00 2024-04-15T23:29:23.719 INFO:teuthology.orchestra.run.smithi102.stdout:(14/153): librados-devel-19.0.0-2114.ga9a752df. 1.2 MB/s | 127 kB 00:00 2024-04-15T23:29:23.746 INFO:teuthology.orchestra.run.smithi115.stdout:(12/153): libcephfs2-19.0.0-2114.ga9a752df.el7. 3.6 MB/s | 746 kB 00:00 2024-04-15T23:29:23.819 INFO:teuthology.orchestra.run.smithi102.stdout:(15/153): libradosstriper1-19.0.0-2114.ga9a752d 4.9 MB/s | 501 kB 00:00 2024-04-15T23:29:23.846 INFO:teuthology.orchestra.run.smithi115.stdout:(13/153): libcephsqlite-19.0.0-2114.ga9a752df.e 1.6 MB/s | 164 kB 00:00 2024-04-15T23:29:23.955 INFO:teuthology.orchestra.run.smithi115.stdout:(14/153): librados-devel-19.0.0-2114.ga9a752df. 1.1 MB/s | 127 kB 00:00 2024-04-15T23:29:24.130 INFO:teuthology.orchestra.run.smithi115.stdout:(15/153): libradosstriper1-19.0.0-2114.ga9a752d 2.8 MB/s | 501 kB 00:00 2024-04-15T23:29:24.213 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-15T23:29:24.547 INFO:teuthology.orchestra.run.smithi115.stdout:(16/153): ceph-common-19.0.0-2114.ga9a752df.el7 3.9 MB/s | 21 MB 00:05 2024-04-15T23:29:24.553 INFO:teuthology.orchestra.run.smithi102.stdout:(16/153): librgw2-19.0.0-2114.ga9a752df.el7.x86 7.0 MB/s | 5.2 MB 00:00 2024-04-15T23:29:24.622 INFO:teuthology.orchestra.run.smithi115.stdout:(17/153): python3-ceph-argparse-19.0.0-2114.ga9 604 kB/s | 45 kB 00:00 2024-04-15T23:29:24.636 INFO:teuthology.orchestra.run.smithi102.stdout:(17/153): python3-ceph-argparse-19.0.0-2114.ga9 543 kB/s | 45 kB 00:00 2024-04-15T23:29:24.714 INFO:teuthology.orchestra.run.smithi115.stdout:(18/153): python3-ceph-common-19.0.0-2114.ga9a7 1.4 MB/s | 131 kB 00:00 2024-04-15T23:29:24.736 INFO:teuthology.orchestra.run.smithi102.stdout:(18/153): python3-ceph-common-19.0.0-2114.ga9a7 1.3 MB/s | 131 kB 00:00 2024-04-15T23:29:24.806 INFO:teuthology.orchestra.run.smithi115.stdout:(19/153): python3-cephfs-19.0.0-2114.ga9a752df. 1.7 MB/s | 162 kB 00:00 2024-04-15T23:29:24.836 INFO:teuthology.orchestra.run.smithi102.stdout:(19/153): python3-cephfs-19.0.0-2114.ga9a752df. 1.6 MB/s | 162 kB 00:00 2024-04-15T23:29:24.954 INFO:teuthology.orchestra.run.smithi102.stdout:(20/153): python3-rados-19.0.0-2114.ga9a752df.e 2.7 MB/s | 320 kB 00:00 2024-04-15T23:29:24.965 INFO:teuthology.orchestra.run.smithi115.stdout:(20/153): python3-rados-19.0.0-2114.ga9a752df.e 2.0 MB/s | 320 kB 00:00 2024-04-15T23:29:25.046 INFO:teuthology.orchestra.run.smithi102.stdout:(21/153): python3-rbd-19.0.0-2114.ga9a752df.el7 3.2 MB/s | 298 kB 00:00 2024-04-15T23:29:25.073 INFO:teuthology.orchestra.run.smithi115.stdout:(21/153): python3-rbd-19.0.0-2114.ga9a752df.el7 2.7 MB/s | 298 kB 00:00 2024-04-15T23:29:25.137 INFO:teuthology.orchestra.run.smithi102.stdout:(22/153): python3-rgw-19.0.0-2114.ga9a752df.el7 1.1 MB/s | 99 kB 00:00 2024-04-15T23:29:25.165 INFO:teuthology.orchestra.run.smithi115.stdout:(22/153): python3-rgw-19.0.0-2114.ga9a752df.el7 1.1 MB/s | 99 kB 00:00 2024-04-15T23:29:25.230 INFO:teuthology.orchestra.run.smithi102.stdout:(23/153): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 930 kB/s | 85 kB 00:00 2024-04-15T23:29:25.257 INFO:teuthology.orchestra.run.smithi115.stdout:(23/153): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 930 kB/s | 85 kB 00:00 2024-04-15T23:29:25.416 INFO:teuthology.orchestra.run.smithi115.stdout:(24/153): librgw2-19.0.0-2114.ga9a752df.el7.x86 4.0 MB/s | 5.2 MB 00:01 2024-04-15T23:29:25.475 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-15T23:29:25.533 INFO:teuthology.orchestra.run.smithi115.stdout:(25/153): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 1.4 MB/s | 171 kB 00:00 2024-04-15T23:29:25.617 INFO:teuthology.orchestra.run.smithi115.stdout:(26/153): ceph-grafana-dashboards-19.0.0-2114.g 380 kB/s | 32 kB 00:00 2024-04-15T23:29:25.655 INFO:teuthology.orchestra.run.smithi102.stdout:(24/153): rbd-mirror-19.0.0-2114.ga9a752df.el7. 7.3 MB/s | 3.1 MB 00:00 2024-04-15T23:29:25.692 INFO:teuthology.orchestra.run.smithi115.stdout:(27/153): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.8 MB/s | 139 kB 00:00 2024-04-15T23:29:25.755 INFO:teuthology.orchestra.run.smithi102.stdout:(25/153): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 1.7 MB/s | 171 kB 00:00 2024-04-15T23:29:25.847 INFO:teuthology.orchestra.run.smithi102.stdout:(26/153): ceph-grafana-dashboards-19.0.0-2114.g 347 kB/s | 32 kB 00:00 2024-04-15T23:29:25.947 INFO:teuthology.orchestra.run.smithi102.stdout:(27/153): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.4 MB/s | 139 kB 00:00 2024-04-15T23:29:26.448 INFO:teuthology.orchestra.run.smithi102.stdout:(28/153): ceph-mgr-dashboard-19.0.0-2114.ga9a75 7.0 MB/s | 3.5 MB 00:00 2024-04-15T23:29:26.517 INFO:teuthology.orchestra.run.smithi115.stdout:(28/153): rbd-mirror-19.0.0-2114.ga9a752df.el7. 2.5 MB/s | 3.1 MB 00:01 2024-04-15T23:29:26.576 INFO:teuthology.orchestra.run.smithi115.stdout:(29/153): ceph-mgr-dashboard-19.0.0-2114.ga9a75 4.0 MB/s | 3.5 MB 00:00 2024-04-15T23:29:26.668 INFO:teuthology.orchestra.run.smithi115.stdout:(30/153): ceph-mgr-modules-core-19.0.0-2114.ga9 2.6 MB/s | 248 kB 00:00 2024-04-15T23:29:26.751 INFO:teuthology.orchestra.run.smithi115.stdout:(31/153): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 591 kB/s | 49 kB 00:00 2024-04-15T23:29:26.843 INFO:teuthology.orchestra.run.smithi115.stdout:(32/153): ceph-prometheus-alerts-19.0.0-2114.ga 167 kB/s | 15 kB 00:00 2024-04-15T23:29:26.993 INFO:teuthology.orchestra.run.smithi115.stdout:(33/153): ceph-volume-19.0.0-2114.ga9a752df.el7 1.7 MB/s | 264 kB 00:00 2024-04-15T23:29:27.235 INFO:teuthology.orchestra.run.smithi115.stdout:(34/153): cephadm-19.0.0-2114.ga9a752df.el7.noa 3.0 MB/s | 749 kB 00:00 2024-04-15T23:29:27.356 INFO:teuthology.orchestra.run.smithi102.stdout:(29/153): ceph-mgr-diskprediction-local-19.0.0- 8.1 MB/s | 7.4 MB 00:00 2024-04-15T23:29:27.393 INFO:teuthology.orchestra.run.smithi115.stdout:(35/153): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2024-04-15T23:29:27.431 INFO:teuthology.orchestra.run.smithi102.stdout:(30/153): ceph-mgr-modules-core-19.0.0-2114.ga9 3.2 MB/s | 248 kB 00:00 2024-04-15T23:29:27.436 INFO:teuthology.orchestra.run.smithi115.stdout:(36/153): bison-3.7.4-5.el9.x86_64.rpm 13 MB/s | 920 kB 00:00 2024-04-15T23:29:27.469 INFO:teuthology.orchestra.run.smithi115.stdout:(37/153): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-04-15T23:29:27.490 INFO:teuthology.orchestra.run.smithi102.stdout:(31/153): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 848 kB/s | 49 kB 00:00 2024-04-15T23:29:27.511 INFO:teuthology.orchestra.run.smithi115.stdout:(38/153): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-04-15T23:29:27.565 INFO:teuthology.orchestra.run.smithi102.stdout:(32/153): ceph-prometheus-alerts-19.0.0-2114.ga 204 kB/s | 15 kB 00:00 2024-04-15T23:29:27.570 INFO:teuthology.orchestra.run.smithi115.stdout:(39/153): flexiblas-3.0.4-8.el9.x86_64.rpm 544 kB/s | 32 kB 00:00 2024-04-15T23:29:27.657 INFO:teuthology.orchestra.run.smithi102.stdout:(33/153): ceph-volume-19.0.0-2114.ga9a752df.el7 2.8 MB/s | 264 kB 00:00 2024-04-15T23:29:27.695 INFO:teuthology.orchestra.run.smithi115.stdout:(40/153): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-04-15T23:29:27.746 INFO:teuthology.orchestra.run.smithi115.stdout:(41/153): flexiblas-openblas-openmp-3.0.4-8.el9 343 kB/s | 17 kB 00:00 2024-04-15T23:29:27.774 INFO:teuthology.orchestra.run.smithi102.stdout:(34/153): cephadm-19.0.0-2114.ga9a752df.el7.noa 6.3 MB/s | 749 kB 00:00 2024-04-15T23:29:27.787 INFO:teuthology.orchestra.run.smithi115.stdout:(42/153): libaio-devel-0.3.111-13.el9.x86_64.rp 241 kB/s | 10 kB 00:00 2024-04-15T23:29:27.821 INFO:teuthology.orchestra.run.smithi115.stdout:(43/153): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-04-15T23:29:27.863 INFO:teuthology.orchestra.run.smithi115.stdout:(44/153): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-04-15T23:29:27.913 INFO:teuthology.orchestra.run.smithi115.stdout:(45/153): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-15T23:29:27.916 INFO:teuthology.orchestra.run.smithi102.stdout:(35/153): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-04-15T23:29:27.964 INFO:teuthology.orchestra.run.smithi115.stdout:(46/153): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-15T23:29:27.974 INFO:teuthology.orchestra.run.smithi102.stdout:(36/153): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-04-15T23:29:27.997 INFO:teuthology.orchestra.run.smithi115.stdout:(47/153): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-04-15T23:29:28.025 INFO:teuthology.orchestra.run.smithi102.stdout:(37/153): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-04-15T23:29:28.039 INFO:teuthology.orchestra.run.smithi115.stdout:(48/153): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-15T23:29:28.067 INFO:teuthology.orchestra.run.smithi102.stdout:(38/153): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-04-15T23:29:28.081 INFO:teuthology.orchestra.run.smithi115.stdout:(49/153): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-04-15T23:29:28.101 INFO:teuthology.orchestra.run.smithi102.stdout:(39/153): flexiblas-3.0.4-8.el9.x86_64.rpm 948 kB/s | 32 kB 00:00 2024-04-15T23:29:28.201 INFO:teuthology.orchestra.run.smithi102.stdout:(40/153): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-04-15T23:29:28.226 INFO:teuthology.orchestra.run.smithi102.stdout:(41/153): flexiblas-openblas-openmp-3.0.4-8.el9 684 kB/s | 17 kB 00:00 2024-04-15T23:29:28.251 INFO:teuthology.orchestra.run.smithi102.stdout:(42/153): libaio-devel-0.3.111-13.el9.x86_64.rp 406 kB/s | 10 kB 00:00 2024-04-15T23:29:28.294 INFO:teuthology.orchestra.run.smithi102.stdout:(43/153): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-04-15T23:29:28.319 INFO:teuthology.orchestra.run.smithi102.stdout:(44/153): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2024-04-15T23:29:28.361 INFO:teuthology.orchestra.run.smithi102.stdout:(45/153): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2024-04-15T23:29:28.411 INFO:teuthology.orchestra.run.smithi102.stdout:(46/153): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-15T23:29:28.436 INFO:teuthology.orchestra.run.smithi102.stdout:(47/153): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2024-04-15T23:29:28.478 INFO:teuthology.orchestra.run.smithi102.stdout:(48/153): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-15T23:29:28.515 INFO:teuthology.orchestra.run.smithi115.stdout:(50/153): ceph-test-19.0.0-2114.ga9a752df.el7.x 8.7 MB/s | 48 MB 00:05 2024-04-15T23:29:28.520 INFO:teuthology.orchestra.run.smithi102.stdout:(49/153): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2024-04-15T23:29:28.540 INFO:teuthology.orchestra.run.smithi115.stdout:(51/153): oniguruma-6.9.6-1.el9.5.x86_64.rpm 473 kB/s | 217 kB 00:00 2024-04-15T23:29:28.557 INFO:teuthology.orchestra.run.smithi115.stdout:(52/153): openblas-0.3.21-2.el9.x86_64.rpm 830 kB/s | 34 kB 00:00 2024-04-15T23:29:28.562 INFO:teuthology.orchestra.run.smithi102.stdout:(50/153): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-04-15T23:29:28.604 INFO:teuthology.orchestra.run.smithi102.stdout:(51/153): openblas-0.3.21-2.el9.x86_64.rpm 821 kB/s | 34 kB 00:00 2024-04-15T23:29:28.704 INFO:teuthology.orchestra.run.smithi115.stdout:(53/153): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2024-04-15T23:29:28.742 INFO:teuthology.orchestra.run.smithi115.stdout:(54/153): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-04-15T23:29:28.746 INFO:teuthology.orchestra.run.smithi102.stdout:(52/153): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-15T23:29:28.821 INFO:teuthology.orchestra.run.smithi102.stdout:(53/153): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-04-15T23:29:28.834 INFO:teuthology.orchestra.run.smithi115.stdout:(55/153): ceph-mgr-diskprediction-local-19.0.0- 3.2 MB/s | 7.4 MB 00:02 2024-04-15T23:29:28.917 INFO:teuthology.orchestra.run.smithi115.stdout:(56/153): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 5.8 MB 00:00 2024-04-15T23:29:28.942 INFO:teuthology.orchestra.run.smithi115.stdout:(57/153): python3-jsonpatch-1.21-16.el9.noarch. 124 kB/s | 24 kB 00:00 2024-04-15T23:29:28.963 INFO:teuthology.orchestra.run.smithi102.stdout:(54/153): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-04-15T23:29:28.967 INFO:teuthology.orchestra.run.smithi115.stdout:(58/153): python3-jsonpointer-2.0-4.el9.noarch. 138 kB/s | 18 kB 00:00 2024-04-15T23:29:28.992 INFO:teuthology.orchestra.run.smithi115.stdout:(59/153): python3-markupsafe-1.1.1-12.el9.x86_6 636 kB/s | 32 kB 00:00 2024-04-15T23:29:29.018 INFO:teuthology.orchestra.run.smithi115.stdout:(60/153): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-04-15T23:29:29.118 INFO:teuthology.orchestra.run.smithi115.stdout:(61/153): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-04-15T23:29:29.143 INFO:teuthology.orchestra.run.smithi115.stdout:(62/153): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-04-15T23:29:29.169 INFO:teuthology.orchestra.run.smithi115.stdout:(63/153): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2024-04-15T23:29:29.194 INFO:teuthology.orchestra.run.smithi115.stdout:(64/153): python3-packaging-20.9-5.el9.noarch.r 923 kB/s | 69 kB 00:00 2024-04-15T23:29:29.219 INFO:teuthology.orchestra.run.smithi115.stdout:(65/153): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-04-15T23:29:29.244 INFO:teuthology.orchestra.run.smithi115.stdout:(66/153): python3-prettytable-0.7.2-27.el9.noar 548 kB/s | 41 kB 00:00 2024-04-15T23:29:29.270 INFO:teuthology.orchestra.run.smithi115.stdout:(67/153): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-15T23:29:29.295 INFO:teuthology.orchestra.run.smithi115.stdout:(68/153): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-04-15T23:29:29.320 INFO:teuthology.orchestra.run.smithi115.stdout:(69/153): python3-pytz-2021.1-5.el9.noarch.rpm 954 kB/s | 47 kB 00:00 2024-04-15T23:29:29.345 INFO:teuthology.orchestra.run.smithi115.stdout:(70/153): python3-requests-oauthlib-1.3.0-12.el 572 kB/s | 43 kB 00:00 2024-04-15T23:29:29.380 INFO:teuthology.orchestra.run.smithi102.stdout:(55/153): ceph-test-19.0.0-2114.ga9a752df.el7.x 7.8 MB/s | 48 MB 00:06 2024-04-15T23:29:29.397 INFO:teuthology.orchestra.run.smithi102.stdout:(56/153): python3-jsonpatch-1.21-16.el9.noarch. 56 kB/s | 24 kB 00:00 2024-04-15T23:29:29.414 INFO:teuthology.orchestra.run.smithi102.stdout:(57/153): python3-jsonpointer-2.0-4.el9.noarch. 547 kB/s | 18 kB 00:00 2024-04-15T23:29:29.456 INFO:teuthology.orchestra.run.smithi102.stdout:(58/153): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-04-15T23:29:29.473 INFO:teuthology.orchestra.run.smithi102.stdout:(59/153): python3-markupsafe-1.1.1-12.el9.x86_6 539 kB/s | 32 kB 00:00 2024-04-15T23:29:29.495 INFO:teuthology.orchestra.run.smithi115.stdout:(71/153): python3-toml-0.10.2-6.el9.noarch.rpm 263 kB/s | 39 kB 00:00 2024-04-15T23:29:29.521 INFO:teuthology.orchestra.run.smithi115.stdout:(72/153): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-04-15T23:29:29.632 INFO:teuthology.orchestra.run.smithi102.stdout:(60/153): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 2.0 MB/s | 17 MB 00:08 2024-04-15T23:29:29.705 INFO:teuthology.orchestra.run.smithi115.stdout:(73/153): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-04-15T23:29:29.715 INFO:teuthology.orchestra.run.smithi102.stdout:(61/153): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2024-04-15T23:29:29.730 INFO:teuthology.orchestra.run.smithi115.stdout:(74/153): qatlib-service-24.02.0-1.el9.x86_64.r 149 kB/s | 35 kB 00:00 2024-04-15T23:29:29.741 INFO:teuthology.orchestra.run.smithi102.stdout:(62/153): python3-numpy-f2py-1.20.1-5.el9.x86_6 813 kB/s | 217 kB 00:00 2024-04-15T23:29:29.755 INFO:teuthology.orchestra.run.smithi115.stdout:(75/153): qatzip-libs-1.2.0-1.el9.x86_64.rpm 200 kB/s | 46 kB 00:00 2024-04-15T23:29:29.766 INFO:teuthology.orchestra.run.smithi102.stdout:(63/153): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2024-04-15T23:29:29.780 INFO:teuthology.orchestra.run.smithi115.stdout:(76/153): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-04-15T23:29:29.791 INFO:teuthology.orchestra.run.smithi102.stdout:(64/153): python3-packaging-20.9-5.el9.noarch.r 922 kB/s | 69 kB 00:00 2024-04-15T23:29:29.805 INFO:teuthology.orchestra.run.smithi115.stdout:(77/153): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-15T23:29:29.816 INFO:teuthology.orchestra.run.smithi102.stdout:(65/153): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-04-15T23:29:29.830 INFO:teuthology.orchestra.run.smithi115.stdout:(78/153): zlib-devel-1.2.11-40.el9.x86_64.rpm 589 kB/s | 44 kB 00:00 2024-04-15T23:29:29.842 INFO:teuthology.orchestra.run.smithi102.stdout:(66/153): python3-prettytable-0.7.2-27.el9.noar 545 kB/s | 41 kB 00:00 2024-04-15T23:29:29.864 INFO:teuthology.orchestra.run.smithi115.stdout:(79/153): fuse-2.9.9-15.el9.x86_64.rpm 942 kB/s | 79 kB 00:00 2024-04-15T23:29:29.867 INFO:teuthology.orchestra.run.smithi102.stdout:(67/153): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-15T23:29:29.884 INFO:teuthology.orchestra.run.smithi102.stdout:(68/153): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-04-15T23:29:29.889 INFO:teuthology.orchestra.run.smithi115.stdout:(80/153): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-15T23:29:29.909 INFO:teuthology.orchestra.run.smithi102.stdout:(69/153): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-04-15T23:29:29.923 INFO:teuthology.orchestra.run.smithi115.stdout:(81/153): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-04-15T23:29:29.934 INFO:teuthology.orchestra.run.smithi102.stdout:(70/153): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 43 kB 00:00 2024-04-15T23:29:29.948 INFO:teuthology.orchestra.run.smithi115.stdout:(82/153): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-04-15T23:29:29.973 INFO:teuthology.orchestra.run.smithi115.stdout:(83/153): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-04-15T23:29:29.998 INFO:teuthology.orchestra.run.smithi115.stdout:(84/153): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-04-15T23:29:30.110 INFO:teuthology.orchestra.run.smithi102.stdout:(71/153): python3-toml-0.10.2-6.el9.noarch.rpm 224 kB/s | 39 kB 00:00 2024-04-15T23:29:30.135 INFO:teuthology.orchestra.run.smithi102.stdout:(72/153): qatlib-24.02.0-1.el9.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2024-04-15T23:29:30.360 INFO:teuthology.orchestra.run.smithi102.stdout:(73/153): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-04-15T23:29:30.386 INFO:teuthology.orchestra.run.smithi102.stdout:(74/153): qatlib-service-24.02.0-1.el9.x86_64.r 127 kB/s | 35 kB 00:00 2024-04-15T23:29:30.419 INFO:teuthology.orchestra.run.smithi102.stdout:(75/153): qatzip-libs-1.2.0-1.el9.x86_64.rpm 165 kB/s | 46 kB 00:00 2024-04-15T23:29:30.452 INFO:teuthology.orchestra.run.smithi102.stdout:(76/153): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 300 kB 00:00 2024-04-15T23:29:30.478 INFO:teuthology.orchestra.run.smithi102.stdout:(77/153): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-04-15T23:29:30.503 INFO:teuthology.orchestra.run.smithi102.stdout:(78/153): zlib-devel-1.2.11-40.el9.x86_64.rpm 532 kB/s | 44 kB 00:00 2024-04-15T23:29:30.528 INFO:teuthology.orchestra.run.smithi102.stdout:(79/153): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-04-15T23:29:30.553 INFO:teuthology.orchestra.run.smithi102.stdout:(80/153): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-15T23:29:30.590 INFO:teuthology.orchestra.run.smithi102.stdout:(81/153): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-04-15T23:29:30.612 INFO:teuthology.orchestra.run.smithi102.stdout:(82/153): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-04-15T23:29:30.637 INFO:teuthology.orchestra.run.smithi102.stdout:(83/153): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-04-15T23:29:30.663 INFO:teuthology.orchestra.run.smithi102.stdout:(84/153): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-04-15T23:29:30.734 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-15T23:29:30.780 INFO:teuthology.orchestra.run.smithi102.stdout:(85/153): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-04-15T23:29:30.805 INFO:teuthology.orchestra.run.smithi102.stdout:(86/153): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-15T23:29:30.830 INFO:teuthology.orchestra.run.smithi102.stdout:(87/153): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-15T23:29:30.840 INFO:teuthology.orchestra.run.smithi115.stdout:(85/153): jq-1.6-16.el9.x86_64.rpm 210 kB/s | 187 kB 00:00 2024-04-15T23:29:30.847 INFO:teuthology.orchestra.run.smithi102.stdout:(88/153): elfutils-libelf-devel-0.190-2.el9.x86 513 kB/s | 21 kB 00:00 2024-04-15T23:29:30.872 INFO:teuthology.orchestra.run.smithi102.stdout:(89/153): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-04-15T23:29:30.889 INFO:teuthology.orchestra.run.smithi102.stdout:(90/153): libuuid-devel-2.37.4-18.el9.x86_64.rp 432 kB/s | 25 kB 00:00 2024-04-15T23:29:30.923 INFO:teuthology.orchestra.run.smithi102.stdout:(91/153): python3-devel-3.9.17-2.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-04-15T23:29:30.932 INFO:teuthology.orchestra.run.smithi115.stdout:(86/153): libquadmath-11.4.1-3.el9.x86_64.rpm 209 kB/s | 195 kB 00:00 2024-04-15T23:29:30.940 INFO:teuthology.orchestra.run.smithi102.stdout:(92/153): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-04-15T23:29:30.973 INFO:teuthology.orchestra.run.smithi102.stdout:(93/153): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-15T23:29:31.024 INFO:teuthology.orchestra.run.smithi102.stdout:(94/153): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-15T23:29:31.033 INFO:teuthology.orchestra.run.smithi115.stdout:(87/153): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-04-15T23:29:31.083 INFO:teuthology.orchestra.run.smithi115.stdout:(88/153): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-15T23:29:31.149 INFO:teuthology.orchestra.run.smithi102.stdout:(95/153): openssl-devel-3.0.7-27.el9.x86_64.rpm 14 MB/s | 4.1 MB 00:00 2024-04-15T23:29:31.291 INFO:teuthology.orchestra.run.smithi102.stdout:(96/153): protobuf-compiler-3.14.0-13.el9.x86_6 2.7 MB/s | 863 kB 00:00 2024-04-15T23:29:31.349 INFO:teuthology.orchestra.run.smithi115.stdout:(89/153): openssl-devel-3.0.7-27.el9.x86_64.rpm 16 MB/s | 4.1 MB 00:00 2024-04-15T23:29:31.392 INFO:teuthology.orchestra.run.smithi115.stdout:(90/153): python3-devel-3.9.17-2.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-04-15T23:29:31.434 INFO:teuthology.orchestra.run.smithi115.stdout:(91/153): python3-jinja2-2.11.3-5.el9.noarch.rp 5.8 MB/s | 248 kB 00:00 2024-04-15T23:29:31.476 INFO:teuthology.orchestra.run.smithi115.stdout:(92/153): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-04-15T23:29:31.510 INFO:teuthology.orchestra.run.smithi115.stdout:(93/153): lua-devel-5.4.4-4.el9.x86_64.rpm 671 kB/s | 22 kB 00:00 2024-04-15T23:29:31.568 INFO:teuthology.orchestra.run.smithi115.stdout:(94/153): protobuf-compiler-3.14.0-13.el9.x86_6 14 MB/s | 863 kB 00:00 2024-04-15T23:29:31.633 INFO:teuthology.orchestra.run.smithi102.stdout:(97/153): grpc-data-1.46.7-10.el9.noarch.rpm 62 kB/s | 19 kB 00:00 2024-04-15T23:29:31.660 INFO:teuthology.orchestra.run.smithi115.stdout:(95/153): libgfortran-11.4.1-3.el9.x86_64.rpm 483 kB/s | 803 kB 00:01 2024-04-15T23:29:31.734 INFO:teuthology.orchestra.run.smithi102.stdout:(98/153): abseil-cpp-20211102.0-3.el9.x86_64.rp 772 kB/s | 548 kB 00:00 2024-04-15T23:29:31.784 INFO:teuthology.orchestra.run.smithi102.stdout:(99/153): gperftools-libs-2.9.1-2.el9.x86_64.rp 508 kB/s | 309 kB 00:00 2024-04-15T23:29:31.810 INFO:teuthology.orchestra.run.smithi115.stdout:(96/153): python3-requests-2.25.1-8.el9.noarch. 129 kB/s | 125 kB 00:00 2024-04-15T23:29:31.817 INFO:teuthology.orchestra.run.smithi102.stdout:(100/153): libarrow-doc-9.0.0-10.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-04-15T23:29:31.876 INFO:teuthology.orchestra.run.smithi102.stdout:(101/153): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-04-15T23:29:31.910 INFO:teuthology.orchestra.run.smithi102.stdout:(102/153): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-04-15T23:29:31.985 INFO:teuthology.orchestra.run.smithi102.stdout:(103/153): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-15T23:29:32.085 INFO:teuthology.orchestra.run.smithi102.stdout:(104/153): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2024-04-15T23:29:32.085 INFO:teuthology.orchestra.run.smithi115.stdout:(97/153): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-04-15T23:29:32.169 INFO:teuthology.orchestra.run.smithi115.stdout:(98/153): abseil-cpp-20211102.0-3.el9.x86_64.rp 913 kB/s | 548 kB 00:00 2024-04-15T23:29:32.185 INFO:teuthology.orchestra.run.smithi102.stdout:(105/153): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-04-15T23:29:32.202 INFO:teuthology.orchestra.run.smithi115.stdout:(99/153): gperftools-libs-2.9.1-2.el9.x86_64.rp 570 kB/s | 309 kB 00:00 2024-04-15T23:29:32.210 INFO:teuthology.orchestra.run.smithi102.stdout:(106/153): python3-bcrypt-3.2.2-1.el9.x86_64.rp 347 kB/s | 43 kB 00:00 2024-04-15T23:29:32.286 INFO:teuthology.orchestra.run.smithi102.stdout:(107/153): libarrow-9.0.0-10.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-04-15T23:29:32.311 INFO:teuthology.orchestra.run.smithi102.stdout:(108/153): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-15T23:29:32.336 INFO:teuthology.orchestra.run.smithi102.stdout:(109/153): python3-cachetools-4.2.4-1.el9.noarc 213 kB/s | 32 kB 00:00 2024-04-15T23:29:32.378 INFO:teuthology.orchestra.run.smithi102.stdout:(110/153): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-04-15T23:29:32.412 INFO:teuthology.orchestra.run.smithi102.stdout:(111/153): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-15T23:29:32.437 INFO:teuthology.orchestra.run.smithi102.stdout:(112/153): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-04-15T23:29:32.445 INFO:teuthology.orchestra.run.smithi115.stdout:(100/153): libarrow-doc-9.0.0-10.el9.noarch.rpm 94 kB/s | 26 kB 00:00 2024-04-15T23:29:32.504 INFO:teuthology.orchestra.run.smithi102.stdout:(113/153): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-15T23:29:32.530 INFO:teuthology.orchestra.run.smithi102.stdout:(114/153): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-15T23:29:32.545 INFO:teuthology.orchestra.run.smithi115.stdout:(101/153): liboath-2.6.7-2.el9.x86_64.rpm 142 kB/s | 49 kB 00:00 2024-04-15T23:29:32.588 INFO:teuthology.orchestra.run.smithi102.stdout:(115/153): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-04-15T23:29:32.613 INFO:teuthology.orchestra.run.smithi102.stdout:(116/153): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-15T23:29:32.639 INFO:teuthology.orchestra.run.smithi102.stdout:(117/153): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-04-15T23:29:32.681 INFO:teuthology.orchestra.run.smithi102.stdout:(118/153): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-15T23:29:32.706 INFO:teuthology.orchestra.run.smithi102.stdout:(119/153): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-04-15T23:29:32.756 INFO:teuthology.orchestra.run.smithi102.stdout:(120/153): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-15T23:29:32.773 INFO:teuthology.orchestra.run.smithi102.stdout:(121/153): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-04-15T23:29:32.798 INFO:teuthology.orchestra.run.smithi102.stdout:(122/153): python3-more-itertools-8.12.0-2.el9. 856 kB/s | 79 kB 00:00 2024-04-15T23:29:32.812 INFO:teuthology.orchestra.run.smithi115.stdout:(102/153): libunwind-1.6.2-1.el9.x86_64.rpm 184 kB/s | 67 kB 00:00 2024-04-15T23:29:32.840 INFO:teuthology.orchestra.run.smithi102.stdout:(123/153): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-04-15T23:29:32.865 INFO:teuthology.orchestra.run.smithi102.stdout:(124/153): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-15T23:29:32.882 INFO:teuthology.orchestra.run.smithi102.stdout:(125/153): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-15T23:29:32.949 INFO:teuthology.orchestra.run.smithi102.stdout:(126/153): python3-pyOpenSSL-21.0.0-1.el9.noarc 828 kB/s | 90 kB 00:00 2024-04-15T23:29:32.966 INFO:teuthology.orchestra.run.smithi102.stdout:(127/153): python3-repoze-lru-0.7-16.el9.noarch 306 kB/s | 31 kB 00:00 2024-04-15T23:29:32.970 INFO:teuthology.orchestra.run.smithi115.stdout:(103/153): luarocks-3.9.2-1.el9.noarch.rpm 355 kB/s | 151 kB 00:00 2024-04-15T23:29:32.983 INFO:teuthology.orchestra.run.smithi102.stdout:(128/153): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-15T23:29:33.042 INFO:teuthology.orchestra.run.smithi102.stdout:(129/153): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2024-04-15T23:29:33.067 INFO:teuthology.orchestra.run.smithi102.stdout:(130/153): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-04-15T23:29:33.092 INFO:teuthology.orchestra.run.smithi102.stdout:(131/153): python3-typing-extensions-4.4.0-2.el 468 kB/s | 51 kB 00:00 2024-04-15T23:29:33.129 INFO:teuthology.orchestra.run.smithi115.stdout:(104/153): libarrow-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-04-15T23:29:33.134 INFO:teuthology.orchestra.run.smithi102.stdout:(132/153): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-15T23:29:33.160 INFO:teuthology.orchestra.run.smithi102.stdout:(133/153): python3-websocket-client-1.2.3-2.el9 973 kB/s | 90 kB 00:00 2024-04-15T23:29:33.202 INFO:teuthology.orchestra.run.smithi102.stdout:(134/153): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-15T23:29:33.227 INFO:teuthology.orchestra.run.smithi102.stdout:(135/153): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-15T23:29:33.244 INFO:teuthology.orchestra.run.smithi102.stdout:(136/153): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-15T23:29:33.386 INFO:teuthology.orchestra.run.smithi102.stdout:(137/153): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-15T23:29:33.420 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:33.421 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:33.453 INFO:teuthology.orchestra.run.smithi102.stdout:(138/153): elfutils-debuginfod-client-0.190-2.e 547 kB/s | 36 kB 00:00 2024-04-15T23:29:33.471 INFO:teuthology.orchestra.run.smithi115.stdout:(105/153): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-15T23:29:33.504 INFO:teuthology.orchestra.run.smithi115.stdout:(106/153): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-15T23:29:33.505 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================ 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================ 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-15T23:29:33.531 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-15T23:29:33.532 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-15T23:29:33.533 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-15T23:29:33.534 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T23:29:33.535 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T23:29:33.536 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T23:29:33.537 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T23:29:33.538 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T23:29:33.539 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T23:29:33.540 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T23:29:33.541 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:29:33.542 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-04-15T23:29:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================ 2024-04-15T23:29:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:Install 137 Packages 2024-04-15T23:29:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 16 Packages 2024-04-15T23:29:33.543 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:29:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 212 M 2024-04-15T23:29:33.543 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-04-15T23:29:33.544 INFO:teuthology.orchestra.run.smithi102.stdout:(139/153): elfutils-libelf-0.190-2.el9.x86_64.r 2.0 MB/s | 192 kB 00:00 2024-04-15T23:29:33.563 INFO:teuthology.orchestra.run.smithi115.stdout:(107/153): python3-asyncssh-2.13.2-5.el9.noarch 925 kB/s | 548 kB 00:00 2024-04-15T23:29:33.653 INFO:teuthology.orchestra.run.smithi102.stdout:(140/153): librbd1-19.0.0-2114.ga9a752df.el7.x8 7.7 MB/s | 3.1 MB 00:00 2024-04-15T23:29:33.678 INFO:teuthology.orchestra.run.smithi102.stdout:(141/153): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-04-15T23:29:33.729 INFO:teuthology.orchestra.run.smithi102.stdout:(142/153): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-15T23:29:33.746 INFO:teuthology.orchestra.run.smithi115.stdout:(108/153): python3-cachetools-4.2.4-1.el9.noarc 117 kB/s | 32 kB 00:00 2024-04-15T23:29:33.772 INFO:teuthology.orchestra.run.smithi115.stdout:(109/153): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-15T23:29:33.779 INFO:teuthology.orchestra.run.smithi102.stdout:(143/153): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-04-15T23:29:33.804 INFO:teuthology.orchestra.run.smithi102.stdout:(144/153): libfdisk-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-04-15T23:29:33.830 INFO:teuthology.orchestra.run.smithi102.stdout:(145/153): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-04-15T23:29:33.863 INFO:teuthology.orchestra.run.smithi102.stdout:(146/153): libuuid-2.37.4-18.el9.x86_64.rpm 490 kB/s | 29 kB 00:00 2024-04-15T23:29:33.922 INFO:teuthology.orchestra.run.smithi102.stdout:(147/153): openssl-3.0.7-27.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-04-15T23:29:33.989 INFO:teuthology.orchestra.run.smithi102.stdout:(148/153): openssl-libs-3.0.7-27.el9.x86_64.rpm 17 MB/s | 2.2 MB 00:00 2024-04-15T23:29:33.997 INFO:teuthology.orchestra.run.smithi115.stdout:(110/153): python3-cheroot-8.6.0-4.el9.noarch.r 396 kB/s | 172 kB 00:00 2024-04-15T23:29:34.039 INFO:teuthology.orchestra.run.smithi102.stdout:(149/153): util-linux-2.37.4-18.el9.x86_64.rpm 20 MB/s | 2.3 MB 00:00 2024-04-15T23:29:34.065 INFO:teuthology.orchestra.run.smithi102.stdout:(150/153): util-linux-core-2.37.4-18.el9.x86_64 6.0 MB/s | 465 kB 00:00 2024-04-15T23:29:34.081 INFO:teuthology.orchestra.run.smithi102.stdout:(151/153): util-linux-user-2.37.4-18.el9.x86_64 744 kB/s | 31 kB 00:00 2024-04-15T23:29:34.165 INFO:teuthology.orchestra.run.smithi102.stdout:(152/153): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-04-15T23:29:34.248 INFO:teuthology.orchestra.run.smithi102.stdout:(153/153): librados2-19.0.0-2114.ga9a752df.el7. 3.3 MB/s | 3.4 MB 00:01 2024-04-15T23:29:34.254 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:29:34.254 INFO:teuthology.orchestra.run.smithi102.stdout:Total 14 MB/s | 212 MB 00:15 2024-04-15T23:29:34.281 INFO:teuthology.orchestra.run.smithi115.stdout:(111/153): python3-google-auth-2.28.2-1.el9.noa 399 kB/s | 203 kB 00:00 2024-04-15T23:29:34.339 INFO:teuthology.orchestra.run.smithi115.stdout:(112/153): python3-cherrypy-18.6.1-2.el9.noarch 605 kB/s | 358 kB 00:00 2024-04-15T23:29:34.393 INFO:teuthology.orchestra.run.smithi107.stdout:(1/153): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 32 kB/s | 6.6 kB 00:00 2024-04-15T23:29:34.523 INFO:teuthology.orchestra.run.smithi115.stdout:(113/153): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-15T23:29:34.618 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-04-15T23:29:34.691 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 776 kB/s | 6.2 MB 00:08 2024-04-15T23:29:34.756 INFO:teuthology.orchestra.run.smithi115.stdout:(114/153): python3-grpcio-1.46.7-10.el9.x86_64. 2.7 MB/s | 2.0 MB 00:00 2024-04-15T23:29:34.782 INFO:teuthology.orchestra.run.smithi115.stdout:(115/153): python3-grpcio-tools-1.46.7-10.el9.x 288 kB/s | 144 kB 00:00 2024-04-15T23:29:34.807 INFO:teuthology.orchestra.run.smithi115.stdout:(116/153): python3-jaraco-classes-3.2.1-5.el9.n 62 kB/s | 18 kB 00:00 2024-04-15T23:29:34.882 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-04-15T23:29:34.882 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-04-15T23:29:35.024 INFO:teuthology.orchestra.run.smithi115.stdout:(117/153): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-04-15T23:29:35.049 INFO:teuthology.orchestra.run.smithi115.stdout:(118/153): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-04-15T23:29:35.059 INFO:teuthology.orchestra.run.smithi107.stdout:(2/153): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 1.3 MB/s | 891 kB 00:00 2024-04-15T23:29:35.074 INFO:teuthology.orchestra.run.smithi115.stdout:(119/153): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-15T23:29:35.201 INFO:teuthology.orchestra.run.smithi107.stdout:(3/153): ceph-base-19.0.0-2114.ga9a752df.el7.x8 5.3 MB/s | 5.3 MB 00:01 2024-04-15T23:29:35.235 INFO:teuthology.orchestra.run.smithi107.stdout:(4/153): ceph-immutable-object-cache-19.0.0-211 827 kB/s | 145 kB 00:00 2024-04-15T23:29:35.408 INFO:teuthology.orchestra.run.smithi115.stdout:(120/153): python3-logutils-0.3.5-21.el9.noarch 129 kB/s | 46 kB 00:00 2024-04-15T23:29:35.433 INFO:teuthology.orchestra.run.smithi115.stdout:(121/153): python3-more-itertools-8.12.0-2.el9. 220 kB/s | 79 kB 00:00 2024-04-15T23:29:35.569 INFO:teuthology.orchestra.run.smithi107.stdout:(5/153): ceph-common-19.0.0-2114.ga9a752df.el7. 15 MB/s | 21 MB 00:01 2024-04-15T23:29:35.627 INFO:teuthology.orchestra.run.smithi107.stdout:(6/153): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 5.5 MB/s | 2.4 MB 00:00 2024-04-15T23:29:35.750 INFO:teuthology.orchestra.run.smithi115.stdout:(122/153): python3-natsort-7.1.1-5.el9.noarch.r 169 kB/s | 58 kB 00:00 2024-04-15T23:29:35.784 INFO:teuthology.orchestra.run.smithi115.stdout:(123/153): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2024-04-15T23:29:35.861 INFO:teuthology.orchestra.run.smithi107.stdout:(7/153): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 16 MB/s | 4.7 MB 00:00 2024-04-15T23:29:36.017 INFO:teuthology.orchestra.run.smithi115.stdout:(124/153): python3-portend-3.1.0-2.el9.noarch.r 61 kB/s | 16 kB 00:00 2024-04-15T23:29:36.042 INFO:teuthology.orchestra.run.smithi115.stdout:(125/153): python3-pecan-1.4.2-3.el9.noarch.rpm 447 kB/s | 272 kB 00:00 2024-04-15T23:29:36.120 INFO:teuthology.orchestra.run.smithi107.stdout:(8/153): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 1.7 MB/s | 1.5 MB 00:00 2024-04-15T23:29:36.209 INFO:teuthology.orchestra.run.smithi115.stdout:(126/153): python3-pyOpenSSL-21.0.0-1.el9.noarc 211 kB/s | 90 kB 00:00 2024-04-15T23:29:36.211 INFO:teuthology.orchestra.run.smithi107.stdout:(9/153): ceph-selinux-19.0.0-2114.ga9a752df.el7 275 kB/s | 25 kB 00:00 2024-04-15T23:29:36.276 INFO:teuthology.orchestra.run.smithi115.stdout:(127/153): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2024-04-15T23:29:36.478 INFO:teuthology.orchestra.run.smithi107.stdout:(10/153): ceph-radosgw-19.0.0-2114.ga9a752df.el 16 MB/s | 9.9 MB 00:00 2024-04-15T23:29:36.537 INFO:teuthology.orchestra.run.smithi107.stdout:(11/153): libcephfs-devel-19.0.0-2114.ga9a752df 546 kB/s | 32 kB 00:00 2024-04-15T23:29:36.577 INFO:teuthology.orchestra.run.smithi115.stdout:(128/153): python3-routes-2.5.1-5.el9.noarch.rp 353 kB/s | 188 kB 00:00 2024-04-15T23:29:36.592 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-04-15T23:29:36.602 INFO:teuthology.orchestra.run.smithi115.stdout:(129/153): python3-tempora-5.0.0-2.el9.noarch.r 110 kB/s | 36 kB 00:00 2024-04-15T23:29:36.627 INFO:teuthology.orchestra.run.smithi115.stdout:(130/153): python3-rsa-4.9-2.el9.noarch.rpm 142 kB/s | 59 kB 00:00 2024-04-15T23:29:36.628 INFO:teuthology.orchestra.run.smithi107.stdout:(12/153): libcephfs2-19.0.0-2114.ga9a752df.el7. 8.0 MB/s | 746 kB 00:00 2024-04-15T23:29:36.704 INFO:teuthology.orchestra.run.smithi107.stdout:(13/153): libcephsqlite-19.0.0-2114.ga9a752df.e 2.1 MB/s | 164 kB 00:00 2024-04-15T23:29:36.765 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-04-15T23:29:36.766 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-04-15T23:29:36.779 INFO:teuthology.orchestra.run.smithi107.stdout:(14/153): librados-devel-19.0.0-2114.ga9a752df. 1.6 MB/s | 127 kB 00:00 2024-04-15T23:29:36.888 INFO:teuthology.orchestra.run.smithi107.stdout:(15/153): libradosstriper1-19.0.0-2114.ga9a752d 4.5 MB/s | 501 kB 00:00 2024-04-15T23:29:36.919 INFO:teuthology.orchestra.run.smithi115.stdout:(131/153): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-15T23:29:36.978 INFO:teuthology.orchestra.run.smithi115.stdout:(132/153): python3-websocket-client-1.2.3-2.el9 256 kB/s | 90 kB 00:00 2024-04-15T23:29:37.111 INFO:teuthology.orchestra.run.smithi115.stdout:(133/153): python3-webob-1.8.7-6.el9.noarch.rpm 451 kB/s | 230 kB 00:00 2024-04-15T23:29:37.245 INFO:teuthology.orchestra.run.smithi115.stdout:(134/153): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-15T23:29:37.371 INFO:teuthology.orchestra.run.smithi107.stdout:(16/153): librgw2-19.0.0-2114.ga9a752df.el7.x86 11 MB/s | 5.2 MB 00:00 2024-04-15T23:29:37.480 INFO:teuthology.orchestra.run.smithi107.stdout:(17/153): python3-ceph-argparse-19.0.0-2114.ga9 418 kB/s | 45 kB 00:00 2024-04-15T23:29:37.503 INFO:teuthology.orchestra.run.smithi115.stdout:(135/153): python3-werkzeug-2.0.3-3.el9.1.noarc 731 kB/s | 427 kB 00:00 2024-04-15T23:29:37.538 INFO:teuthology.orchestra.run.smithi107.stdout:(18/153): python3-ceph-common-19.0.0-2114.ga9a7 2.2 MB/s | 131 kB 00:00 2024-04-15T23:29:37.545 INFO:teuthology.orchestra.run.smithi115.stdout:(136/153): re2-20211101-3.el9.x86_64.rpm 442 kB/s | 192 kB 00:00 2024-04-15T23:29:37.605 INFO:teuthology.orchestra.run.smithi107.stdout:(19/153): python3-cephfs-19.0.0-2114.ga9a752df. 2.4 MB/s | 162 kB 00:00 2024-04-15T23:29:37.672 INFO:teuthology.orchestra.run.smithi107.stdout:(20/153): python3-rados-19.0.0-2114.ga9a752df.e 4.7 MB/s | 320 kB 00:00 2024-04-15T23:29:37.839 INFO:teuthology.orchestra.run.smithi107.stdout:(21/153): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 7.6 MB/s | 17 MB 00:02 2024-04-15T23:29:37.873 INFO:teuthology.orchestra.run.smithi107.stdout:(22/153): python3-rbd-19.0.0-2114.ga9a752df.el7 1.5 MB/s | 298 kB 00:00 2024-04-15T23:29:37.898 INFO:teuthology.orchestra.run.smithi107.stdout:(23/153): python3-rgw-19.0.0-2114.ga9a752df.el7 1.7 MB/s | 99 kB 00:00 2024-04-15T23:29:37.923 INFO:teuthology.orchestra.run.smithi107.stdout:(24/153): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.7 MB/s | 85 kB 00:00 2024-04-15T23:29:37.937 INFO:teuthology.orchestra.run.smithi115.stdout:(137/153): librbd1-19.0.0-2114.ga9a752df.el7.x8 8.0 MB/s | 3.1 MB 00:00 2024-04-15T23:29:37.982 INFO:teuthology.orchestra.run.smithi107.stdout:(25/153): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 2.9 MB/s | 171 kB 00:00 2024-04-15T23:29:38.004 INFO:teuthology.orchestra.run.smithi115.stdout:(138/153): thrift-0.15.0-2.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-04-15T23:29:38.024 INFO:teuthology.orchestra.run.smithi107.stdout:(26/153): ceph-grafana-dashboards-19.0.0-2114.g 762 kB/s | 32 kB 00:00 2024-04-15T23:29:38.081 INFO:teuthology.orchestra.run.smithi115.stdout:(139/153): librados2-19.0.0-2114.ga9a752df.el7. 5.9 MB/s | 3.4 MB 00:00 2024-04-15T23:29:38.082 INFO:teuthology.orchestra.run.smithi107.stdout:(27/153): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 2.3 MB/s | 139 kB 00:00 2024-04-15T23:29:38.150 INFO:teuthology.orchestra.run.smithi107.stdout:(28/153): rbd-mirror-19.0.0-2114.ga9a752df.el7. 12 MB/s | 3.1 MB 00:00 2024-04-15T23:29:38.291 INFO:teuthology.orchestra.run.smithi107.stdout:(29/153): ceph-mgr-dashboard-19.0.0-2114.ga9a75 17 MB/s | 3.5 MB 00:00 2024-04-15T23:29:38.350 INFO:teuthology.orchestra.run.smithi107.stdout:(30/153): ceph-mgr-modules-core-19.0.0-2114.ga9 4.2 MB/s | 248 kB 00:00 2024-04-15T23:29:38.408 INFO:teuthology.orchestra.run.smithi107.stdout:(31/153): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 846 kB/s | 49 kB 00:00 2024-04-15T23:29:38.459 INFO:teuthology.orchestra.run.smithi107.stdout:(32/153): ceph-prometheus-alerts-19.0.0-2114.ga 307 kB/s | 15 kB 00:00 2024-04-15T23:29:38.526 INFO:teuthology.orchestra.run.smithi107.stdout:(33/153): ceph-volume-19.0.0-2114.ga9a752df.el7 3.9 MB/s | 264 kB 00:00 2024-04-15T23:29:38.618 INFO:teuthology.orchestra.run.smithi107.stdout:(34/153): cephadm-19.0.0-2114.ga9a752df.el7.noa 8.0 MB/s | 749 kB 00:00 2024-04-15T23:29:38.621 INFO:teuthology.orchestra.run.smithi115.stdout:(140/153): elfutils-debuginfod-client-0.190-2.e 53 kB/s | 36 kB 00:00 2024-04-15T23:29:38.785 INFO:teuthology.orchestra.run.smithi107.stdout:(35/153): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-04-15T23:29:38.846 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 21 MB 00:02 2024-04-15T23:29:38.926 INFO:teuthology.orchestra.run.smithi107.stdout:(36/153): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-04-15T23:29:38.980 INFO:teuthology.orchestra.run.smithi115.stdout:(141/153): elfutils-libelf-0.190-2.el9.x86_64.r 197 kB/s | 192 kB 00:00 2024-04-15T23:29:38.993 INFO:teuthology.orchestra.run.smithi107.stdout:(37/153): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 920 kB 00:00 2024-04-15T23:29:39.018 INFO:teuthology.orchestra.run.smithi107.stdout:(38/153): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2024-04-15T23:29:39.038 INFO:teuthology.orchestra.run.smithi115.stdout:(142/153): elfutils-libs-0.190-2.el9.x86_64.rpm 267 kB/s | 256 kB 00:00 2024-04-15T23:29:39.044 INFO:teuthology.orchestra.run.smithi107.stdout:(39/153): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-04-15T23:29:39.061 INFO:teuthology.orchestra.run.smithi107.stdout:(40/153): flexiblas-3.0.4-8.el9.x86_64.rpm 760 kB/s | 32 kB 00:00 2024-04-15T23:29:39.153 INFO:teuthology.orchestra.run.smithi107.stdout:(41/153): flexiblas-openblas-openmp-3.0.4-8.el9 187 kB/s | 17 kB 00:00 2024-04-15T23:29:39.211 INFO:teuthology.orchestra.run.smithi107.stdout:(42/153): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-04-15T23:29:39.228 INFO:teuthology.orchestra.run.smithi107.stdout:(43/153): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 10 kB 00:00 2024-04-15T23:29:39.254 INFO:teuthology.orchestra.run.smithi107.stdout:(44/153): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-04-15T23:29:39.270 INFO:teuthology.orchestra.run.smithi107.stdout:(45/153): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-04-15T23:29:39.304 INFO:teuthology.orchestra.run.smithi107.stdout:(46/153): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-15T23:29:39.330 INFO:teuthology.orchestra.run.smithi107.stdout:(47/153): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-04-15T23:29:39.346 INFO:teuthology.orchestra.run.smithi107.stdout:(48/153): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-04-15T23:29:39.372 INFO:teuthology.orchestra.run.smithi107.stdout:(49/153): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-15T23:29:39.397 INFO:teuthology.orchestra.run.smithi115.stdout:(143/153): libblkid-2.37.4-18.el9.x86_64.rpm 140 kB/s | 108 kB 00:00 2024-04-15T23:29:39.397 INFO:teuthology.orchestra.run.smithi107.stdout:(50/153): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-04-15T23:29:39.422 INFO:teuthology.orchestra.run.smithi107.stdout:(51/153): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-04-15T23:29:39.439 INFO:teuthology.orchestra.run.smithi107.stdout:(52/153): openblas-0.3.21-2.el9.x86_64.rpm 828 kB/s | 34 kB 00:00 2024-04-15T23:29:39.589 INFO:teuthology.orchestra.run.smithi107.stdout:(53/153): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-04-15T23:29:39.623 INFO:teuthology.orchestra.run.smithi107.stdout:(54/153): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-04-15T23:29:39.774 INFO:teuthology.orchestra.run.smithi107.stdout:(55/153): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-04-15T23:29:39.797 INFO:teuthology.orchestra.run.smithi115.stdout:(144/153): libfdisk-2.37.4-18.el9.x86_64.rpm 190 kB/s | 155 kB 00:00 2024-04-15T23:29:39.798 INFO:teuthology.orchestra.run.smithi107.stdout:(56/153): python3-jsonpatch-1.21-16.el9.noarch. 141 kB/s | 24 kB 00:00 2024-04-15T23:29:39.822 INFO:teuthology.orchestra.run.smithi115.stdout:(145/153): libmount-2.37.4-18.el9.x86_64.rpm 173 kB/s | 136 kB 00:00 2024-04-15T23:29:39.824 INFO:teuthology.orchestra.run.smithi107.stdout:(57/153): python3-jsonpointer-2.0-4.el9.noarch. 363 kB/s | 18 kB 00:00 2024-04-15T23:29:39.849 INFO:teuthology.orchestra.run.smithi107.stdout:(58/153): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-04-15T23:29:39.874 INFO:teuthology.orchestra.run.smithi107.stdout:(59/153): python3-markupsafe-1.1.1-12.el9.x86_6 629 kB/s | 32 kB 00:00 2024-04-15T23:29:40.000 INFO:teuthology.orchestra.run.smithi107.stdout:(60/153): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-04-15T23:29:40.025 INFO:teuthology.orchestra.run.smithi107.stdout:(61/153): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-04-15T23:29:40.050 INFO:teuthology.orchestra.run.smithi107.stdout:(62/153): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-04-15T23:29:40.075 INFO:teuthology.orchestra.run.smithi107.stdout:(63/153): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-04-15T23:29:40.081 INFO:teuthology.orchestra.run.smithi115.stdout:(146/153): libsmartcols-2.37.4-18.el9.x86_64.rp 93 kB/s | 64 kB 00:00 2024-04-15T23:29:40.100 INFO:teuthology.orchestra.run.smithi107.stdout:(64/153): python3-prettytable-0.7.2-27.el9.noar 822 kB/s | 41 kB 00:00 2024-04-15T23:29:40.126 INFO:teuthology.orchestra.run.smithi107.stdout:(65/153): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-04-15T23:29:40.151 INFO:teuthology.orchestra.run.smithi107.stdout:(66/153): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-04-15T23:29:40.176 INFO:teuthology.orchestra.run.smithi107.stdout:(67/153): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-04-15T23:29:40.202 INFO:teuthology.orchestra.run.smithi107.stdout:(68/153): python3-pytz-2021.1-5.el9.noarch.rpm 947 kB/s | 47 kB 00:00 2024-04-15T23:29:40.227 INFO:teuthology.orchestra.run.smithi107.stdout:(69/153): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2024-04-15T23:29:40.398 INFO:teuthology.orchestra.run.smithi115.stdout:(147/153): libuuid-2.37.4-18.el9.x86_64.rpm 48 kB/s | 29 kB 00:00 2024-04-15T23:29:40.412 INFO:teuthology.orchestra.run.smithi107.stdout:(70/153): python3-toml-0.10.2-6.el9.noarch.rpm 212 kB/s | 39 kB 00:00 2024-04-15T23:29:40.603 INFO:teuthology.orchestra.run.smithi107.stdout:(71/153): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-04-15T23:29:40.628 INFO:teuthology.orchestra.run.smithi107.stdout:(72/153): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2024-04-15T23:29:40.653 INFO:teuthology.orchestra.run.smithi107.stdout:(73/153): qatlib-service-24.02.0-1.el9.x86_64.r 699 kB/s | 35 kB 00:00 2024-04-15T23:29:40.678 INFO:teuthology.orchestra.run.smithi107.stdout:(74/153): qatzip-libs-1.2.0-1.el9.x86_64.rpm 921 kB/s | 46 kB 00:00 2024-04-15T23:29:40.704 INFO:teuthology.orchestra.run.smithi107.stdout:(75/153): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-04-15T23:29:40.737 INFO:teuthology.orchestra.run.smithi107.stdout:(76/153): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-04-15T23:29:40.754 INFO:teuthology.orchestra.run.smithi107.stdout:(77/153): zlib-devel-1.2.11-40.el9.x86_64.rpm 877 kB/s | 44 kB 00:00 2024-04-15T23:29:40.779 INFO:teuthology.orchestra.run.smithi107.stdout:(78/153): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-04-15T23:29:40.804 INFO:teuthology.orchestra.run.smithi107.stdout:(79/153): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-15T23:29:40.838 INFO:teuthology.orchestra.run.smithi107.stdout:(80/153): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-04-15T23:29:40.864 INFO:teuthology.orchestra.run.smithi107.stdout:(81/153): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-04-15T23:29:40.889 INFO:teuthology.orchestra.run.smithi107.stdout:(82/153): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-04-15T23:29:40.914 INFO:teuthology.orchestra.run.smithi107.stdout:(83/153): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-04-15T23:29:41.098 INFO:teuthology.orchestra.run.smithi107.stdout:(84/153): jq-1.6-16.el9.x86_64.rpm 897 kB/s | 187 kB 00:00 2024-04-15T23:29:41.182 INFO:teuthology.orchestra.run.smithi107.stdout:(85/153): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-15T23:29:41.232 INFO:teuthology.orchestra.run.smithi107.stdout:(86/153): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-15T23:29:41.257 INFO:teuthology.orchestra.run.smithi107.stdout:(87/153): libgfortran-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 803 kB 00:00 2024-04-15T23:29:41.516 INFO:teuthology.orchestra.run.smithi107.stdout:(88/153): libuuid-devel-2.37.4-18.el9.x86_64.rp 98 kB/s | 25 kB 00:00 2024-04-15T23:29:41.533 INFO:teuthology.orchestra.run.smithi107.stdout:(89/153): elfutils-libelf-devel-0.190-2.el9.x86 71 kB/s | 21 kB 00:00 2024-04-15T23:29:41.948 INFO:teuthology.orchestra.run.smithi115.stdout:(148/153): openssl-3.0.7-27.el9.x86_64.rpm 583 kB/s | 1.2 MB 00:02 2024-04-15T23:29:41.958 INFO:teuthology.orchestra.run.smithi107.stdout:(90/153): python3-devel-3.9.17-2.el9.x86_64.rpm 577 kB/s | 245 kB 00:00 2024-04-15T23:29:42.150 INFO:teuthology.orchestra.run.smithi107.stdout:(91/153): python3-jinja2-2.11.3-5.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-04-15T23:29:42.258 INFO:teuthology.orchestra.run.smithi107.stdout:(92/153): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 866 kB/s | 94 kB 00:00 2024-04-15T23:29:42.400 INFO:teuthology.orchestra.run.smithi107.stdout:(93/153): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-04-15T23:29:42.492 INFO:teuthology.orchestra.run.smithi107.stdout:(94/153): openssl-devel-3.0.7-27.el9.x86_64.rpm 4.2 MB/s | 4.1 MB 00:00 2024-04-15T23:29:42.684 INFO:teuthology.orchestra.run.smithi107.stdout:(95/153): protobuf-compiler-3.14.0-13.el9.x86_6 3.0 MB/s | 863 kB 00:00 2024-04-15T23:29:42.843 INFO:teuthology.orchestra.run.smithi107.stdout:(96/153): abseil-cpp-20211102.0-3.el9.x86_64.rp 1.5 MB/s | 548 kB 00:00 2024-04-15T23:29:42.910 INFO:teuthology.orchestra.run.smithi107.stdout:(97/153): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-04-15T23:29:42.932 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-04-15T23:29:42.985 INFO:teuthology.orchestra.run.smithi107.stdout:(98/153): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.0 MB/s | 309 kB 00:00 2024-04-15T23:29:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/169 2024-04-15T23:29:43.051 INFO:teuthology.orchestra.run.smithi107.stdout:(99/153): libarrow-doc-9.0.0-10.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-04-15T23:29:43.140 INFO:teuthology.orchestra.run.smithi115.stdout:(149/153): util-linux-core-2.37.4-18.el9.x86_64 390 kB/s | 465 kB 00:01 2024-04-15T23:29:43.160 INFO:teuthology.orchestra.run.smithi107.stdout:(100/153): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-04-15T23:29:43.179 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/169 2024-04-15T23:29:43.185 INFO:teuthology.orchestra.run.smithi107.stdout:(101/153): liboath-2.6.7-2.el9.x86_64.rpm 363 kB/s | 49 kB 00:00 2024-04-15T23:29:43.227 INFO:teuthology.orchestra.run.smithi107.stdout:(102/153): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-15T23:29:43.261 INFO:teuthology.orchestra.run.smithi107.stdout:(103/153): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-15T23:29:43.309 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:29:43.311 INFO:teuthology.orchestra.run.smithi107.stdout:(104/153): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-04-15T23:29:43.321 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:29:43.361 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/169 2024-04-15T23:29:43.386 INFO:teuthology.orchestra.run.smithi107.stdout:(105/153): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-15T23:29:43.412 INFO:teuthology.orchestra.run.smithi107.stdout:(106/153): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-04-15T23:29:43.417 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/169 2024-04-15T23:29:43.454 INFO:teuthology.orchestra.run.smithi107.stdout:(107/153): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-04-15T23:29:43.455 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/169 2024-04-15T23:29:43.465 INFO:teuthology.orchestra.run.smithi115.stdout:(150/153): openssl-libs-3.0.7-27.el9.x86_64.rpm 658 kB/s | 2.2 MB 00:03 2024-04-15T23:29:43.479 INFO:teuthology.orchestra.run.smithi107.stdout:(108/153): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-04-15T23:29:43.480 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/169 2024-04-15T23:29:43.526 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/169 2024-04-15T23:29:43.529 INFO:teuthology.orchestra.run.smithi107.stdout:(109/153): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-15T23:29:43.554 INFO:teuthology.orchestra.run.smithi107.stdout:(110/153): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-15T23:29:43.605 INFO:teuthology.orchestra.run.smithi107.stdout:(111/153): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-04-15T23:29:43.663 INFO:teuthology.orchestra.run.smithi107.stdout:(112/153): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-04-15T23:29:43.689 INFO:teuthology.orchestra.run.smithi107.stdout:(113/153): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-15T23:29:43.731 INFO:teuthology.orchestra.run.smithi107.stdout:(114/153): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-15T23:29:43.748 INFO:teuthology.orchestra.run.smithi107.stdout:(115/153): python3-jaraco-classes-3.2.1-5.el9.n 300 kB/s | 18 kB 00:00 2024-04-15T23:29:43.748 INFO:teuthology.orchestra.run.smithi115.stdout:(151/153): util-linux-user-2.37.4-18.el9.x86_64 51 kB/s | 31 kB 00:00 2024-04-15T23:29:43.789 INFO:teuthology.orchestra.run.smithi107.stdout:(116/153): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-04-15T23:29:43.806 INFO:teuthology.orchestra.run.smithi107.stdout:(117/153): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-04-15T23:29:43.848 INFO:teuthology.orchestra.run.smithi107.stdout:(118/153): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-04-15T23:29:43.860 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-15T23:29:43.867 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/169 2024-04-15T23:29:43.930 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:29:43.932 INFO:teuthology.orchestra.run.smithi107.stdout:(119/153): python3-kubernetes-26.1.0-2.el9.noar 8.2 MB/s | 1.0 MB 00:00 2024-04-15T23:29:43.957 INFO:teuthology.orchestra.run.smithi115.stdout:(152/153): util-linux-2.37.4-18.el9.x86_64.rpm 657 kB/s | 2.3 MB 00:03 2024-04-15T23:29:44.007 INFO:teuthology.orchestra.run.smithi107.stdout:(120/153): python3-logutils-0.3.5-21.el9.noarch 292 kB/s | 46 kB 00:00 2024-04-15T23:29:44.032 INFO:teuthology.orchestra.run.smithi107.stdout:(121/153): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-04-15T23:29:44.051 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:29:44.074 INFO:teuthology.orchestra.run.smithi107.stdout:(122/153): python3-natsort-7.1.1-5.el9.noarch.r 863 kB/s | 58 kB 00:00 2024-04-15T23:29:44.081 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:29:44.108 INFO:teuthology.orchestra.run.smithi107.stdout:(123/153): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-15T23:29:44.142 INFO:teuthology.orchestra.run.smithi107.stdout:(124/153): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-04-15T23:29:44.163 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:29:44.175 INFO:teuthology.orchestra.run.smithi107.stdout:(125/153): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-15T23:29:44.209 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:29:44.209 INFO:teuthology.orchestra.run.smithi107.stdout:(126/153): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-04-15T23:29:44.251 INFO:teuthology.orchestra.run.smithi107.stdout:(127/153): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-15T23:29:44.264 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/169 2024-04-15T23:29:44.276 INFO:teuthology.orchestra.run.smithi107.stdout:(128/153): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-04-15T23:29:44.292 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:29:44.318 INFO:teuthology.orchestra.run.smithi107.stdout:(129/153): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-04-15T23:29:44.360 INFO:teuthology.orchestra.run.smithi107.stdout:(130/153): python3-typing-extensions-4.4.0-2.el 609 kB/s | 51 kB 00:00 2024-04-15T23:29:44.379 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:29:44.393 INFO:teuthology.orchestra.run.smithi107.stdout:(131/153): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-15T23:29:44.402 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:29:44.427 INFO:teuthology.orchestra.run.smithi107.stdout:(132/153): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-04-15T23:29:44.467 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:29:44.469 INFO:teuthology.orchestra.run.smithi107.stdout:(133/153): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-15T23:29:44.494 INFO:teuthology.orchestra.run.smithi107.stdout:(134/153): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-04-15T23:29:44.505 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 16/169 2024-04-15T23:29:44.528 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:29:44.544 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:29:44.545 INFO:teuthology.orchestra.run.smithi107.stdout:(135/153): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-15T23:29:44.595 INFO:teuthology.orchestra.run.smithi107.stdout:(136/153): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-15T23:29:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:29:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:29:44.811 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/169 2024-04-15T23:29:44.920 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/169 2024-04-15T23:29:44.937 INFO:teuthology.orchestra.run.smithi107.stdout:(137/153): librbd1-19.0.0-2114.ga9a752df.el7.x8 9.2 MB/s | 3.1 MB 00:00 2024-04-15T23:29:44.995 INFO:teuthology.orchestra.run.smithi107.stdout:(138/153): librados2-19.0.0-2114.ga9a752df.el7. 7.5 MB/s | 3.4 MB 00:00 2024-04-15T23:29:45.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 21/169 2024-04-15T23:29:45.020 INFO:teuthology.orchestra.run.smithi107.stdout:(139/153): elfutils-debuginfod-client-0.190-2.e 437 kB/s | 36 kB 00:00 2024-04-15T23:29:45.050 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/169 2024-04-15T23:29:45.079 INFO:teuthology.orchestra.run.smithi107.stdout:(140/153): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-04-15T23:29:45.084 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/169 2024-04-15T23:29:45.104 INFO:teuthology.orchestra.run.smithi107.stdout:(141/153): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-04-15T23:29:45.130 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/169 2024-04-15T23:29:45.130 INFO:teuthology.orchestra.run.smithi107.stdout:(142/153): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-04-15T23:29:45.163 INFO:teuthology.orchestra.run.smithi107.stdout:(143/153): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-04-15T23:29:45.189 INFO:teuthology.orchestra.run.smithi107.stdout:(144/153): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-04-15T23:29:45.203 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/169 2024-04-15T23:29:45.206 INFO:teuthology.orchestra.run.smithi107.stdout:(145/153): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-15T23:29:45.231 INFO:teuthology.orchestra.run.smithi107.stdout:(146/153): libuuid-2.37.4-18.el9.x86_64.rpm 680 kB/s | 29 kB 00:00 2024-04-15T23:29:45.258 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/169 2024-04-15T23:29:45.304 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/169 2024-04-15T23:29:45.376 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 28/169 2024-04-15T23:29:45.407 INFO:teuthology.orchestra.run.smithi115.stdout:(153/153): xfsprogs-6.3.0-1.el9.x86_64.rpm 566 kB/s | 1.1 MB 00:01 2024-04-15T23:29:45.411 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 29/169 2024-04-15T23:29:45.412 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:29:45.412 INFO:teuthology.orchestra.run.smithi115.stdout:Total 7.9 MB/s | 212 MB 00:26 2024-04-15T23:29:45.440 INFO:teuthology.orchestra.run.smithi107.stdout:(147/153): openssl-3.0.7-27.el9.x86_64.rpm 5.2 MB/s | 1.2 MB 00:00 2024-04-15T23:29:45.454 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 30/169 2024-04-15T23:29:45.489 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 31/169 2024-04-15T23:29:45.516 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/169 2024-04-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 33/169 2024-04-15T23:29:45.620 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 34/169 2024-04-15T23:29:45.657 INFO:teuthology.orchestra.run.smithi107.stdout:(148/153): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.1 MB/s | 2.2 MB 00:00 2024-04-15T23:29:45.664 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 35/169 2024-04-15T23:29:45.692 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 36/169 2024-04-15T23:29:45.757 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-15T23:29:45.762 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/169 2024-04-15T23:29:45.765 INFO:teuthology.orchestra.run.smithi107.stdout:(149/153): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-04-15T23:29:45.807 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-1.el9.noarch 38/169 2024-04-15T23:29:45.815 INFO:teuthology.orchestra.run.smithi107.stdout:(150/153): util-linux-user-2.37.4-18.el9.x86_64 621 kB/s | 31 kB 00:00 2024-04-15T23:29:45.857 INFO:teuthology.orchestra.run.smithi107.stdout:(151/153): util-linux-2.37.4-18.el9.x86_64.rpm 5.5 MB/s | 2.3 MB 00:00 2024-04-15T23:29:45.881 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/169 2024-04-15T23:29:45.991 INFO:teuthology.orchestra.run.smithi107.stdout:(152/153): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.1 MB/s | 1.1 MB 00:00 2024-04-15T23:29:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-15T23:29:46.014 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-15T23:29:46.017 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/169 2024-04-15T23:29:46.091 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/169 2024-04-15T23:29:46.558 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:46.559 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-15T23:29:46.617 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/169 2024-04-15T23:29:46.645 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-04-15T23:29:46.672 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 6.6 k 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.3 M 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 891 k 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 145 k 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 1.5 M 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 139 k 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 3.5 M 2024-04-15T23:29:46.673 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 7.4 M 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 49 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 9.9 M 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 48 M 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 264 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 749 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 32 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 746 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 127 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-04-15T23:29:46.674 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 162 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 320 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 298 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 99 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 85 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 171 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-15T23:29:46.675 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.4 M 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 3.1 M 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-15T23:29:46.676 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 21 M 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 32 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 2.4 M 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 248 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 4.7 M 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 17 M 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2114.ga9a752df.el7 ceph-noarch 15 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 25 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-15T23:29:46.677 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 164 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 501 k 2024-04-15T23:29:46.678 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 5.2 M 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-15T23:29:46.679 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 45 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.0.0-2114.ga9a752df.el7 ceph 131 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-15T23:29:46.680 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-15T23:29:46.681 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-15T23:29:46.682 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-15T23:29:46.683 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout:Install 137 Packages 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 16 Packages 2024-04-15T23:29:46.684 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:29:46.685 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 212 M 2024-04-15T23:29:46.685 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-04-15T23:29:46.697 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/169 2024-04-15T23:29:46.792 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 44/169 2024-04-15T23:29:46.842 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:29:46.854 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:29:46.890 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/169 2024-04-15T23:29:46.940 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 47/169 2024-04-15T23:29:46.969 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 48/169 2024-04-15T23:29:47.000 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/169 2024-04-15T23:29:47.309 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 50/169 2024-04-15T23:29:47.476 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 51/169 2024-04-15T23:29:47.560 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 52/169 2024-04-15T23:29:47.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 53/169 2024-04-15T23:29:47.761 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 54/169 2024-04-15T23:29:47.798 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 55/169 2024-04-15T23:29:47.853 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 56/169 2024-04-15T23:29:47.925 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/169 2024-04-15T23:29:47.926 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-15T23:29:47.926 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-15T23:29:47.957 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 58/169 2024-04-15T23:29:47.994 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 59/169 2024-04-15T23:29:48.040 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/169 2024-04-15T23:29:48.045 INFO:teuthology.orchestra.run.smithi195.stdout:(1/153): ceph-19.0.0-2114.ga9a752df.el7.x86_64. 13 kB/s | 6.6 kB 00:00 2024-04-15T23:29:48.085 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/169 2024-04-15T23:29:48.128 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 62/169 2024-04-15T23:29:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 63/169 2024-04-15T23:29:48.295 INFO:teuthology.orchestra.run.smithi195.stdout:(2/153): ceph-fuse-19.0.0-2114.ga9a752df.el7.x8 3.5 MB/s | 891 kB 00:00 2024-04-15T23:29:48.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 64/169 2024-04-15T23:29:48.339 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 65/169 2024-04-15T23:29:48.362 INFO:teuthology.orchestra.run.smithi195.stdout:(3/153): ceph-immutable-object-cache-19.0.0-211 2.1 MB/s | 145 kB 00:00 2024-04-15T23:29:48.433 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 66/169 2024-04-15T23:29:48.481 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 67/169 2024-04-15T23:29:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/169 2024-04-15T23:29:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 69/169 2024-04-15T23:29:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 70/169 2024-04-15T23:29:48.829 INFO:teuthology.orchestra.run.smithi195.stdout:(4/153): ceph-mds-19.0.0-2114.ga9a752df.el7.x86 5.1 MB/s | 2.4 MB 00:00 2024-04-15T23:29:48.870 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/169 2024-04-15T23:29:49.004 INFO:teuthology.orchestra.run.smithi195.stdout:(5/153): ceph-base-19.0.0-2114.ga9a752df.el7.x8 3.6 MB/s | 5.3 MB 00:01 2024-04-15T23:29:49.009 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 72/169 2024-04-15T23:29:49.114 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/169 2024-04-15T23:29:49.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 74/169 2024-04-15T23:29:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 75/169 2024-04-15T23:29:49.259 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 76/169 2024-04-15T23:29:49.443 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 77/169 2024-04-15T23:29:49.454 INFO:teuthology.orchestra.run.smithi195.stdout:(6/153): ceph-mgr-19.0.0-2114.ga9a752df.el7.x86 2.4 MB/s | 1.5 MB 00:00 2024-04-15T23:29:49.492 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 78/169 2024-04-15T23:29:49.620 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/169 2024-04-15T23:29:49.655 INFO:teuthology.orchestra.run.smithi195.stdout:(7/153): ceph-common-19.0.0-2114.ga9a752df.el7. 9.7 MB/s | 21 MB 00:02 2024-04-15T23:29:49.657 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 80/169 2024-04-15T23:29:49.698 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 81/169 2024-04-15T23:29:49.729 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 82/169 2024-04-15T23:29:49.729 INFO:teuthology.orchestra.run.smithi195.stdout:(8/153): ceph-mon-19.0.0-2114.ga9a752df.el7.x86 6.5 MB/s | 4.7 MB 00:00 2024-04-15T23:29:49.756 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 83/169 2024-04-15T23:29:49.794 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 84/169 2024-04-15T23:29:49.813 INFO:teuthology.orchestra.run.smithi195.stdout:(9/153): ceph-selinux-19.0.0-2114.ga9a752df.el7 303 kB/s | 25 kB 00:00 2024-04-15T23:29:49.824 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/169 2024-04-15T23:29:49.900 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/169 2024-04-15T23:29:49.934 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 87/169 2024-04-15T23:29:49.967 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 88/169 2024-04-15T23:29:50.009 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/169 2024-04-15T23:29:50.043 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/169 2024-04-15T23:29:50.132 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/169 2024-04-15T23:29:50.240 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 92/169 2024-04-15T23:29:50.292 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 93/169 2024-04-15T23:29:50.331 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/169 2024-04-15T23:29:50.378 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 95/169 2024-04-15T23:29:50.431 INFO:teuthology.orchestra.run.smithi195.stdout:(10/153): ceph-radosgw-19.0.0-2114.ga9a752df.el 13 MB/s | 9.9 MB 00:00 2024-04-15T23:29:50.476 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 96/169 2024-04-15T23:29:50.489 INFO:teuthology.orchestra.run.smithi195.stdout:(11/153): libcephfs-devel-19.0.0-2114.ga9a752df 547 kB/s | 32 kB 00:00 2024-04-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 97/169 2024-04-15T23:29:50.581 INFO:teuthology.orchestra.run.smithi195.stdout:(12/153): libcephfs2-19.0.0-2114.ga9a752df.el7. 8.0 MB/s | 746 kB 00:00 2024-04-15T23:29:50.639 INFO:teuthology.orchestra.run.smithi195.stdout:(13/153): libcephsqlite-19.0.0-2114.ga9a752df.e 2.7 MB/s | 164 kB 00:00 2024-04-15T23:29:50.690 INFO:teuthology.orchestra.run.smithi195.stdout:(14/153): librados-devel-19.0.0-2114.ga9a752df. 2.5 MB/s | 127 kB 00:00 2024-04-15T23:29:50.773 INFO:teuthology.orchestra.run.smithi195.stdout:(15/153): libradosstriper1-19.0.0-2114.ga9a752d 5.9 MB/s | 501 kB 00:00 2024-04-15T23:29:51.223 INFO:teuthology.orchestra.run.smithi195.stdout:(16/153): librgw2-19.0.0-2114.ga9a752df.el7.x86 11 MB/s | 5.2 MB 00:00 2024-04-15T23:29:51.250 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/169 2024-04-15T23:29:51.282 INFO:teuthology.orchestra.run.smithi195.stdout:(17/153): python3-ceph-argparse-19.0.0-2114.ga9 778 kB/s | 45 kB 00:00 2024-04-15T23:29:51.296 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 99/169 2024-04-15T23:29:51.330 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 100/169 2024-04-15T23:29:51.349 INFO:teuthology.orchestra.run.smithi195.stdout:(18/153): python3-ceph-common-19.0.0-2114.ga9a7 1.9 MB/s | 131 kB 00:00 2024-04-15T23:29:51.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 101/169 2024-04-15T23:29:51.416 INFO:teuthology.orchestra.run.smithi195.stdout:(19/153): python3-cephfs-19.0.0-2114.ga9a752df. 2.4 MB/s | 162 kB 00:00 2024-04-15T23:29:51.532 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 102/169 2024-04-15T23:29:51.569 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 103/169 2024-04-15T23:29:51.616 INFO:teuthology.orchestra.run.smithi195.stdout:(20/153): ceph-osd-19.0.0-2114.ga9a752df.el7.x8 7.8 MB/s | 17 MB 00:02 2024-04-15T23:29:51.641 INFO:teuthology.orchestra.run.smithi195.stdout:(21/153): python3-rados-19.0.0-2114.ga9a752df.e 1.4 MB/s | 320 kB 00:00 2024-04-15T23:29:51.647 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 104/169 2024-04-15T23:29:51.700 INFO:teuthology.orchestra.run.smithi195.stdout:(22/153): python3-rbd-19.0.0-2114.ga9a752df.el7 3.5 MB/s | 298 kB 00:00 2024-04-15T23:29:51.725 INFO:teuthology.orchestra.run.smithi195.stdout:(23/153): python3-rgw-19.0.0-2114.ga9a752df.el7 1.2 MB/s | 99 kB 00:00 2024-04-15T23:29:51.784 INFO:teuthology.orchestra.run.smithi195.stdout:(24/153): rbd-fuse-19.0.0-2114.ga9a752df.el7.x8 1.0 MB/s | 85 kB 00:00 2024-04-15T23:29:51.876 INFO:teuthology.orchestra.run.smithi195.stdout:(25/153): rbd-nbd-19.0.0-2114.ga9a752df.el7.x86 1.8 MB/s | 171 kB 00:00 2024-04-15T23:29:51.943 INFO:teuthology.orchestra.run.smithi195.stdout:(26/153): ceph-grafana-dashboards-19.0.0-2114.g 476 kB/s | 32 kB 00:00 2024-04-15T23:29:52.002 INFO:teuthology.orchestra.run.smithi195.stdout:(27/153): rbd-mirror-19.0.0-2114.ga9a752df.el7. 11 MB/s | 3.1 MB 00:00 2024-04-15T23:29:52.018 INFO:teuthology.orchestra.run.smithi195.stdout:(28/153): ceph-mgr-cephadm-19.0.0-2114.ga9a752d 1.8 MB/s | 139 kB 00:00 2024-04-15T23:29:52.040 INFO:teuthology.orchestra.run.smithi107.stdout:(153/153): ceph-test-19.0.0-2114.ga9a752df.el7. 3.0 MB/s | 48 MB 00:15 2024-04-15T23:29:52.044 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:29:52.044 INFO:teuthology.orchestra.run.smithi107.stdout:Total 11 MB/s | 212 MB 00:18 2024-04-15T23:29:52.288 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 105/169 2024-04-15T23:29:52.302 INFO:teuthology.orchestra.run.smithi195.stdout:(29/153): ceph-mgr-dashboard-19.0.0-2114.ga9a75 12 MB/s | 3.5 MB 00:00 2024-04-15T23:29:52.361 INFO:teuthology.orchestra.run.smithi195.stdout:(30/153): ceph-mgr-modules-core-19.0.0-2114.ga9 4.2 MB/s | 248 kB 00:00 2024-04-15T23:29:52.387 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-04-15T23:29:52.407 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 106/169 2024-04-15T23:29:52.427 INFO:teuthology.orchestra.run.smithi195.stdout:(31/153): ceph-mgr-rook-19.0.0-2114.ga9a752df.e 742 kB/s | 49 kB 00:00 2024-04-15T23:29:52.486 INFO:teuthology.orchestra.run.smithi195.stdout:(32/153): ceph-prometheus-alerts-19.0.0-2114.ga 263 kB/s | 15 kB 00:00 2024-04-15T23:29:52.562 INFO:teuthology.orchestra.run.smithi195.stdout:(33/153): ceph-volume-19.0.0-2114.ga9a752df.el7 3.4 MB/s | 264 kB 00:00 2024-04-15T23:29:52.644 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-04-15T23:29:52.644 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-04-15T23:29:52.662 INFO:teuthology.orchestra.run.smithi195.stdout:(34/153): cephadm-19.0.0-2114.ga9a752df.el7.noa 7.3 MB/s | 749 kB 00:00 2024-04-15T23:29:52.829 INFO:teuthology.orchestra.run.smithi195.stdout:(35/153): ceph-mgr-diskprediction-local-19.0.0- 9.1 MB/s | 7.4 MB 00:00 2024-04-15T23:29:52.929 INFO:teuthology.orchestra.run.smithi195.stdout:(36/153): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2024-04-15T23:29:52.963 INFO:teuthology.orchestra.run.smithi195.stdout:(37/153): bison-3.7.4-5.el9.x86_64.rpm 6.8 MB/s | 920 kB 00:00 2024-04-15T23:29:52.988 INFO:teuthology.orchestra.run.smithi195.stdout:(38/153): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-04-15T23:29:53.013 INFO:teuthology.orchestra.run.smithi195.stdout:(39/153): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-04-15T23:29:53.038 INFO:teuthology.orchestra.run.smithi195.stdout:(40/153): flexiblas-3.0.4-8.el9.x86_64.rpm 637 kB/s | 32 kB 00:00 2024-04-15T23:29:53.130 INFO:teuthology.orchestra.run.smithi195.stdout:(41/153): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-15T23:29:53.156 INFO:teuthology.orchestra.run.smithi195.stdout:(42/153): flexiblas-openblas-openmp-3.0.4-8.el9 148 kB/s | 17 kB 00:00 2024-04-15T23:29:53.181 INFO:teuthology.orchestra.run.smithi195.stdout:(43/153): libaio-devel-0.3.111-13.el9.x86_64.rp 200 kB/s | 10 kB 00:00 2024-04-15T23:29:53.206 INFO:teuthology.orchestra.run.smithi195.stdout:(44/153): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-15T23:29:53.231 INFO:teuthology.orchestra.run.smithi195.stdout:(45/153): librabbitmq-0.11.0-7.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2024-04-15T23:29:53.257 INFO:teuthology.orchestra.run.smithi195.stdout:(46/153): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-04-15T23:29:53.282 INFO:teuthology.orchestra.run.smithi195.stdout:(47/153): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-04-15T23:29:53.307 INFO:teuthology.orchestra.run.smithi195.stdout:(48/153): libzstd-devel-1.5.1-2.el9.x86_64.rpm 938 kB/s | 46 kB 00:00 2024-04-15T23:29:53.333 INFO:teuthology.orchestra.run.smithi195.stdout:(49/153): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-04-15T23:29:53.358 INFO:teuthology.orchestra.run.smithi195.stdout:(50/153): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-04-15T23:29:53.383 INFO:teuthology.orchestra.run.smithi195.stdout:(51/153): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-04-15T23:29:53.408 INFO:teuthology.orchestra.run.smithi195.stdout:(52/153): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-04-15T23:29:53.526 INFO:teuthology.orchestra.run.smithi195.stdout:(53/153): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-15T23:29:53.559 INFO:teuthology.orchestra.run.smithi195.stdout:(54/153): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-04-15T23:29:53.642 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 107/169 2024-04-15T23:29:53.710 INFO:teuthology.orchestra.run.smithi195.stdout:(55/153): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-04-15T23:29:53.719 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 108/169 2024-04-15T23:29:53.735 INFO:teuthology.orchestra.run.smithi195.stdout:(56/153): python3-jsonpatch-1.21-16.el9.noarch. 141 kB/s | 24 kB 00:00 2024-04-15T23:29:53.751 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 109/169 2024-04-15T23:29:53.766 INFO:teuthology.orchestra.run.smithi195.stdout:(57/153): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 18 kB 00:00 2024-04-15T23:29:53.782 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-16.el9.x86_64 110/169 2024-04-15T23:29:53.794 INFO:teuthology.orchestra.run.smithi195.stdout:(58/153): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-04-15T23:29:53.819 INFO:teuthology.orchestra.run.smithi195.stdout:(59/153): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 32 kB 00:00 2024-04-15T23:29:53.826 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 111/169 2024-04-15T23:29:53.947 INFO:teuthology.orchestra.run.smithi195.stdout:(60/153): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 4.8 MB 00:00 2024-04-15T23:29:53.978 INFO:teuthology.orchestra.run.smithi195.stdout:(61/153): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-04-15T23:29:54.003 INFO:teuthology.orchestra.run.smithi195.stdout:(62/153): python3-oauthlib-3.1.1-5.el9.noarch.r 3.1 MB/s | 174 kB 00:00 2024-04-15T23:29:54.029 INFO:teuthology.orchestra.run.smithi195.stdout:(63/153): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-04-15T23:29:54.054 INFO:teuthology.orchestra.run.smithi195.stdout:(64/153): python3-prettytable-0.7.2-27.el9.noar 821 kB/s | 41 kB 00:00 2024-04-15T23:29:54.079 INFO:teuthology.orchestra.run.smithi195.stdout:(65/153): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-04-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-15T23:29:54.104 INFO:teuthology.orchestra.run.smithi195.stdout:(66/153): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-04-15T23:29:54.130 INFO:teuthology.orchestra.run.smithi195.stdout:(67/153): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-04-15T23:29:54.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 112/169 2024-04-15T23:29:54.155 INFO:teuthology.orchestra.run.smithi195.stdout:(68/153): python3-pytz-2021.1-5.el9.noarch.rpm 946 kB/s | 47 kB 00:00 2024-04-15T23:29:54.174 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:29:54.177 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/169 2024-04-15T23:29:54.180 INFO:teuthology.orchestra.run.smithi195.stdout:(69/153): python3-requests-oauthlib-1.3.0-12.el 852 kB/s | 43 kB 00:00 2024-04-15T23:29:54.223 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/169 2024-04-15T23:29:54.258 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:29:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:29:54.281 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:29:54.311 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 114/169 2024-04-15T23:29:54.339 INFO:teuthology.orchestra.run.smithi195.stdout:(70/153): python3-toml-0.10.2-6.el9.noarch.rpm 246 kB/s | 39 kB 00:00 2024-04-15T23:29:54.347 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/169 2024-04-15T23:29:54.347 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 115/169 2024-04-15T23:29:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/169 2024-04-15T23:29:54.462 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/169 2024-04-15T23:29:54.496 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/169 2024-04-15T23:29:54.497 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-04-15T23:29:54.497 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-04-15T23:29:54.542 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/169 2024-04-15T23:29:54.598 INFO:teuthology.orchestra.run.smithi195.stdout:(71/153): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2024-04-15T23:29:54.623 INFO:teuthology.orchestra.run.smithi195.stdout:(72/153): qatlib-24.02.0-1.el9.x86_64.rpm 781 kB/s | 220 kB 00:00 2024-04-15T23:29:54.648 INFO:teuthology.orchestra.run.smithi195.stdout:(73/153): qatlib-service-24.02.0-1.el9.x86_64.r 702 kB/s | 35 kB 00:00 2024-04-15T23:29:54.673 INFO:teuthology.orchestra.run.smithi195.stdout:(74/153): qatzip-libs-1.2.0-1.el9.x86_64.rpm 926 kB/s | 46 kB 00:00 2024-04-15T23:29:54.707 INFO:teuthology.orchestra.run.smithi195.stdout:(75/153): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-04-15T23:29:54.732 INFO:teuthology.orchestra.run.smithi195.stdout:(76/153): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-04-15T23:29:54.757 INFO:teuthology.orchestra.run.smithi195.stdout:(77/153): zlib-devel-1.2.11-40.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-04-15T23:29:54.783 INFO:teuthology.orchestra.run.smithi195.stdout:(78/153): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-04-15T23:29:54.808 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 116/169 2024-04-15T23:29:54.808 INFO:teuthology.orchestra.run.smithi195.stdout:(79/153): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-04-15T23:29:54.836 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:29:54.842 INFO:teuthology.orchestra.run.smithi195.stdout:(80/153): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-04-15T23:29:54.867 INFO:teuthology.orchestra.run.smithi195.stdout:(81/153): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-04-15T23:29:54.888 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/169 2024-04-15T23:29:54.892 INFO:teuthology.orchestra.run.smithi195.stdout:(82/153): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-04-15T23:29:54.899 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:29:54.917 INFO:teuthology.orchestra.run.smithi195.stdout:(83/153): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-04-15T23:29:54.921 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 118/169 2024-04-15T23:29:54.946 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:29:55.053 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:29:55.081 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:29:55.156 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:29:55.198 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:29:55.274 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/169 2024-04-15T23:29:55.301 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:29:55.368 INFO:teuthology.orchestra.run.smithi195.stdout:(84/153): ceph-test-19.0.0-2114.ga9a752df.el7.x 8.6 MB/s | 48 MB 00:05 2024-04-15T23:29:55.404 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:29:55.427 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:29:55.493 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:29:55.510 INFO:teuthology.orchestra.run.smithi195.stdout:(85/153): jq-1.6-16.el9.x86_64.rpm 303 kB/s | 187 kB 00:00 2024-04-15T23:29:55.539 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 16/169 2024-04-15T23:29:55.562 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:29:55.578 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:29:55.619 INFO:teuthology.orchestra.run.smithi195.stdout:(86/153): libquadmath-11.4.1-3.el9.x86_64.rpm 781 kB/s | 195 kB 00:00 2024-04-15T23:29:55.661 INFO:teuthology.orchestra.run.smithi195.stdout:(87/153): python3-requests-2.25.1-8.el9.noarch. 831 kB/s | 125 kB 00:00 2024-04-15T23:29:55.721 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:29:55.752 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:29:55.804 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/169 2024-04-15T23:29:55.811 INFO:teuthology.orchestra.run.smithi195.stdout:(88/153): libgfortran-11.4.1-3.el9.x86_64.rpm 899 kB/s | 803 kB 00:00 2024-04-15T23:29:55.895 INFO:teuthology.orchestra.run.smithi195.stdout:(89/153): elfutils-libelf-devel-0.190-2.el9.x86 78 kB/s | 21 kB 00:00 2024-04-15T23:29:55.912 INFO:teuthology.orchestra.run.smithi195.stdout:(90/153): libuuid-devel-2.37.4-18.el9.x86_64.rp 102 kB/s | 25 kB 00:00 2024-04-15T23:29:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/169 2024-04-15T23:29:55.987 INFO:teuthology.orchestra.run.smithi195.stdout:(91/153): python3-devel-3.9.17-2.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-04-15T23:29:56.012 INFO:teuthology.orchestra.run.smithi195.stdout:(92/153): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-15T23:29:56.016 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 21/169 2024-04-15T23:29:56.061 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/169 2024-04-15T23:29:56.062 INFO:teuthology.orchestra.run.smithi195.stdout:(93/153): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-04-15T23:29:56.092 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/169 2024-04-15T23:29:56.132 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/169 2024-04-15T23:29:56.171 INFO:teuthology.orchestra.run.smithi195.stdout:(94/153): openssl-devel-3.0.7-27.el9.x86_64.rpm 12 MB/s | 4.1 MB 00:00 2024-04-15T23:29:56.206 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/169 2024-04-15T23:29:56.259 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/169 2024-04-15T23:29:56.297 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/169 2024-04-15T23:29:56.304 INFO:teuthology.orchestra.run.smithi195.stdout:(95/153): abseil-cpp-20211102.0-3.el9.x86_64.rp 4.0 MB/s | 548 kB 00:00 2024-04-15T23:29:56.346 INFO:teuthology.orchestra.run.smithi195.stdout:(96/153): gperftools-libs-2.9.1-2.el9.x86_64.rp 7.2 MB/s | 309 kB 00:00 2024-04-15T23:29:56.361 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 28/169 2024-04-15T23:29:56.405 INFO:teuthology.orchestra.run.smithi195.stdout:(97/153): grpc-data-1.46.7-10.el9.noarch.rpm 605 kB/s | 19 kB 00:00 2024-04-15T23:29:56.406 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 29/169 2024-04-15T23:29:56.457 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 30/169 2024-04-15T23:29:56.490 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 31/169 2024-04-15T23:29:56.518 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/169 2024-04-15T23:29:56.522 INFO:teuthology.orchestra.run.smithi195.stdout:(98/153): libarrow-9.0.0-10.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-04-15T23:29:56.555 INFO:teuthology.orchestra.run.smithi195.stdout:(99/153): libarrow-doc-9.0.0-10.el9.noarch.rpm 782 kB/s | 26 kB 00:00 2024-04-15T23:29:56.586 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 33/169 2024-04-15T23:29:56.589 INFO:teuthology.orchestra.run.smithi195.stdout:(100/153): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-04-15T23:29:56.614 INFO:teuthology.orchestra.run.smithi195.stdout:(101/153): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-04-15T23:29:56.630 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 34/169 2024-04-15T23:29:56.640 INFO:teuthology.orchestra.run.smithi195.stdout:(102/153): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-04-15T23:29:56.674 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 35/169 2024-04-15T23:29:56.681 INFO:teuthology.orchestra.run.smithi195.stdout:(103/153): parquet-libs-9.0.0-10.el9.x86_64.rpm 20 MB/s | 838 kB 00:00 2024-04-15T23:29:56.711 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 36/169 2024-04-15T23:29:56.724 INFO:teuthology.orchestra.run.smithi195.stdout:(104/153): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-04-15T23:29:56.749 INFO:teuthology.orchestra.run.smithi195.stdout:(105/153): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-04-15T23:29:56.774 INFO:teuthology.orchestra.run.smithi195.stdout:(106/153): python3-bcrypt-3.2.2-1.el9.x86_64.rp 869 kB/s | 43 kB 00:00 2024-04-15T23:29:56.779 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/169 2024-04-15T23:29:56.799 INFO:teuthology.orchestra.run.smithi195.stdout:(107/153): python3-cachetools-4.2.4-1.el9.noarc 639 kB/s | 32 kB 00:00 2024-04-15T23:29:56.824 INFO:teuthology.orchestra.run.smithi195.stdout:(108/153): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-15T23:29:56.825 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : luarocks-3.9.2-1.el9.noarch 38/169 2024-04-15T23:29:56.899 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/169 2024-04-15T23:29:56.983 INFO:teuthology.orchestra.run.smithi195.stdout:(109/153): python3-cheroot-8.6.0-4.el9.noarch.r 935 kB/s | 172 kB 00:00 2024-04-15T23:29:57.017 INFO:teuthology.orchestra.run.smithi195.stdout:(110/153): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2024-04-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/169 2024-04-15T23:29:57.042 INFO:teuthology.orchestra.run.smithi195.stdout:(111/153): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-04-15T23:29:57.075 INFO:teuthology.orchestra.run.smithi195.stdout:(112/153): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-04-15T23:29:57.094 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/169 2024-04-15T23:29:57.117 INFO:teuthology.orchestra.run.smithi195.stdout:(113/153): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-04-15T23:29:57.136 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:29:57.143 INFO:teuthology.orchestra.run.smithi195.stdout:(114/153): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-04-15T23:29:57.160 INFO:teuthology.orchestra.run.smithi195.stdout:(115/153): python3-jaraco-classes-3.2.1-5.el9.n 419 kB/s | 18 kB 00:00 2024-04-15T23:29:57.167 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:29:57.177 INFO:teuthology.orchestra.run.smithi195.stdout:(116/153): python3-jaraco-collections-3.0.0-8.e 695 kB/s | 23 kB 00:00 2024-04-15T23:29:57.194 INFO:teuthology.orchestra.run.smithi195.stdout:(117/153): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2024-04-15T23:29:57.211 INFO:teuthology.orchestra.run.smithi195.stdout:(118/153): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-04-15T23:29:57.245 INFO:teuthology.orchestra.run.smithi195.stdout:(119/153): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-04-15T23:29:57.261 INFO:teuthology.orchestra.run.smithi195.stdout:(120/153): python3-logutils-0.3.5-21.el9.noarch 921 kB/s | 46 kB 00:00 2024-04-15T23:29:57.287 INFO:teuthology.orchestra.run.smithi195.stdout:(121/153): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-04-15T23:29:57.304 INFO:teuthology.orchestra.run.smithi195.stdout:(122/153): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-04-15T23:29:57.329 INFO:teuthology.orchestra.run.smithi195.stdout:(123/153): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-04-15T23:29:57.346 INFO:teuthology.orchestra.run.smithi195.stdout:(124/153): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-04-15T23:29:57.371 INFO:teuthology.orchestra.run.smithi195.stdout:(125/153): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-04-15T23:29:57.388 INFO:teuthology.orchestra.run.smithi195.stdout:(126/153): python3-repoze-lru-0.7-16.el9.noarch 734 kB/s | 31 kB 00:00 2024-04-15T23:29:57.434 INFO:teuthology.orchestra.run.smithi195.stdout:(127/153): python3-routes-2.5.1-5.el9.noarch.rp 3.0 MB/s | 188 kB 00:00 2024-04-15T23:29:57.455 INFO:teuthology.orchestra.run.smithi195.stdout:(128/153): python3-rsa-4.9-2.el9.noarch.rpm 886 kB/s | 59 kB 00:00 2024-04-15T23:29:57.472 INFO:teuthology.orchestra.run.smithi195.stdout:(129/153): python3-tempora-5.0.0-2.el9.noarch.r 943 kB/s | 36 kB 00:00 2024-04-15T23:29:57.489 INFO:teuthology.orchestra.run.smithi195.stdout:(130/153): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-04-15T23:29:57.515 INFO:teuthology.orchestra.run.smithi195.stdout:(131/153): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-04-15T23:29:57.540 INFO:teuthology.orchestra.run.smithi195.stdout:(132/153): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-15T23:29:57.565 INFO:teuthology.orchestra.run.smithi195.stdout:(133/153): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-15T23:29:57.582 INFO:teuthology.orchestra.run.smithi195.stdout:(134/153): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-04-15T23:29:57.607 INFO:teuthology.orchestra.run.smithi195.stdout:(135/153): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-04-15T23:29:57.611 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/169 2024-04-15T23:29:57.649 INFO:teuthology.orchestra.run.smithi195.stdout:(136/153): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-04-15T23:29:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/169 2024-04-15T23:29:57.728 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:29:57.763 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:29:57.800 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 44/169 2024-04-15T23:29:57.851 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:29:57.853 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:29:57.854 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T23:29:57.854 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T23:29:57.854 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:29:57.861 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:29:57.889 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:29:57.906 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/169 2024-04-15T23:29:57.964 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 47/169 2024-04-15T23:29:58.003 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 48/169 2024-04-15T23:29:58.034 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/169 2024-04-15T23:29:58.091 INFO:teuthology.orchestra.run.smithi195.stdout:(137/153): protobuf-compiler-3.14.0-13.el9.x86_ 426 kB/s | 863 kB 00:02 2024-04-15T23:29:58.178 INFO:teuthology.orchestra.run.smithi195.stdout:(138/153): elfutils-debuginfod-client-0.190-2.e 627 kB/s | 36 kB 00:00 2024-04-15T23:29:58.283 INFO:teuthology.orchestra.run.smithi195.stdout:(139/153): elfutils-libelf-0.190-2.el9.x86_64.r 1.4 MB/s | 192 kB 00:00 2024-04-15T23:29:58.364 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 50/169 2024-04-15T23:29:58.417 INFO:teuthology.orchestra.run.smithi195.stdout:(140/153): librados2-19.0.0-2114.ga9a752df.el7. 4.2 MB/s | 3.4 MB 00:00 2024-04-15T23:29:58.484 INFO:teuthology.orchestra.run.smithi195.stdout:(141/153): librbd1-19.0.0-2114.ga9a752df.el7.x8 3.8 MB/s | 3.1 MB 00:00 2024-04-15T23:29:58.509 INFO:teuthology.orchestra.run.smithi195.stdout:(142/153): elfutils-libs-0.190-2.el9.x86_64.rpm 1.1 MB/s | 256 kB 00:00 2024-04-15T23:29:58.534 INFO:teuthology.orchestra.run.smithi195.stdout:(143/153): libblkid-2.37.4-18.el9.x86_64.rpm 926 kB/s | 108 kB 00:00 2024-04-15T23:29:58.579 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 51/169 2024-04-15T23:29:58.601 INFO:teuthology.orchestra.run.smithi195.stdout:(144/153): libfdisk-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 155 kB 00:00 2024-04-15T23:29:58.627 INFO:teuthology.orchestra.run.smithi195.stdout:(145/153): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-04-15T23:29:58.652 INFO:teuthology.orchestra.run.smithi195.stdout:(146/153): libsmartcols-2.37.4-18.el9.x86_64.rp 544 kB/s | 64 kB 00:00 2024-04-15T23:29:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 52/169 2024-04-15T23:29:58.677 INFO:teuthology.orchestra.run.smithi195.stdout:(147/153): libuuid-2.37.4-18.el9.x86_64.rpm 380 kB/s | 29 kB 00:00 2024-04-15T23:29:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 53/169 2024-04-15T23:29:58.895 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 54/169 2024-04-15T23:29:58.948 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 55/169 2024-04-15T23:29:59.002 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 56/169 2024-04-15T23:29:59.020 INFO:teuthology.orchestra.run.smithi195.stdout:(148/153): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.9 MB/s | 2.2 MB 00:00 2024-04-15T23:29:59.053 INFO:teuthology.orchestra.run.smithi195.stdout:(149/153): openssl-3.0.7-27.el9.x86_64.rpm 3.0 MB/s | 1.2 MB 00:00 2024-04-15T23:29:59.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/169 2024-04-15T23:29:59.099 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 58/169 2024-04-15T23:29:59.103 INFO:teuthology.orchestra.run.smithi195.stdout:(150/153): util-linux-user-2.37.4-18.el9.x86_64 623 kB/s | 31 kB 00:00 2024-04-15T23:29:59.128 INFO:teuthology.orchestra.run.smithi195.stdout:(151/153): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-04-15T23:29:59.135 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 59/169 2024-04-15T23:29:59.181 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/169 2024-04-15T23:29:59.227 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/169 2024-04-15T23:29:59.269 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 62/169 2024-04-15T23:29:59.270 INFO:teuthology.orchestra.run.smithi195.stdout:(152/153): util-linux-2.37.4-18.el9.x86_64.rpm 3.9 MB/s | 2.3 MB 00:00 2024-04-15T23:29:59.354 INFO:teuthology.orchestra.run.smithi195.stdout:(153/153): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.3 MB/s | 1.1 MB 00:00 2024-04-15T23:29:59.357 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-04-15T23:29:59.357 INFO:teuthology.orchestra.run.smithi195.stdout:Total 17 MB/s | 212 MB 00:12 2024-04-15T23:29:59.409 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 63/169 2024-04-15T23:29:59.454 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 64/169 2024-04-15T23:29:59.495 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 65/169 2024-04-15T23:29:59.588 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 66/169 2024-04-15T23:29:59.621 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 67/169 2024-04-15T23:29:59.664 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/169 2024-04-15T23:29:59.688 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 69/169 2024-04-15T23:29:59.702 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-04-15T23:29:59.713 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 70/169 2024-04-15T23:29:59.793 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/169 2024-04-15T23:29:59.921 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 72/169 2024-04-15T23:29:59.958 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-04-15T23:29:59.959 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-04-15T23:30:00.020 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/169 2024-04-15T23:30:00.063 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 74/169 2024-04-15T23:30:00.111 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 75/169 2024-04-15T23:30:00.177 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 76/169 2024-04-15T23:30:00.359 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 77/169 2024-04-15T23:30:00.409 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 78/169 2024-04-15T23:30:00.546 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/169 2024-04-15T23:30:00.591 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 80/169 2024-04-15T23:30:00.622 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 81/169 2024-04-15T23:30:00.653 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-15.el9.x86_64 82/169 2024-04-15T23:30:00.659 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-04-15T23:30:00.681 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 83/169 2024-04-15T23:30:00.743 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 84/169 2024-04-15T23:30:00.752 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/169 2024-04-15T23:30:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/169 2024-04-15T23:30:00.787 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/169 2024-04-15T23:30:00.816 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:30:00.826 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:30:00.850 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/169 2024-04-15T23:30:00.866 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/169 2024-04-15T23:30:00.883 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 87/169 2024-04-15T23:30:00.917 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 88/169 2024-04-15T23:30:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/169 2024-04-15T23:30:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/169 2024-04-15T23:30:00.967 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/169 2024-04-15T23:30:01.006 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/169 2024-04-15T23:30:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/169 2024-04-15T23:30:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/169 2024-04-15T23:30:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/169 2024-04-15T23:30:01.189 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 92/169 2024-04-15T23:30:01.232 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 93/169 2024-04-15T23:30:01.264 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/169 2024-04-15T23:30:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 95/169 2024-04-15T23:30:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-20.9-5.el9.noarch 96/169 2024-04-15T23:30:01.444 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/169 2024-04-15T23:30:01.471 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:01.482 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 97/169 2024-04-15T23:30:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:01.763 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:30:01.836 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-04-15T23:30:01.836 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-04-15T23:30:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/169 2024-04-15T23:30:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:01.978 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:30:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:30:02.103 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 16/169 2024-04-15T23:30:02.126 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:30:02.155 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:30:02.208 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/169 2024-04-15T23:30:02.254 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 99/169 2024-04-15T23:30:02.288 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 100/169 2024-04-15T23:30:02.320 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 101/169 2024-04-15T23:30:02.352 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:30:02.383 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:30:02.446 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/169 2024-04-15T23:30:02.490 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.21-2.el9.x86_64 102/169 2024-04-15T23:30:02.518 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 103/169 2024-04-15T23:30:02.547 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/169 2024-04-15T23:30:02.598 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 104/169 2024-04-15T23:30:02.636 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 21/169 2024-04-15T23:30:02.668 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/169 2024-04-15T23:30:02.698 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/169 2024-04-15T23:30:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/169 2024-04-15T23:30:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/169 2024-04-15T23:30:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/169 2024-04-15T23:30:02.905 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/169 2024-04-15T23:30:02.978 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 28/169 2024-04-15T23:30:03.012 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 29/169 2024-04-15T23:30:03.056 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 30/169 2024-04-15T23:30:03.096 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 31/169 2024-04-15T23:30:03.123 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/169 2024-04-15T23:30:03.193 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 33/169 2024-04-15T23:30:03.228 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 34/169 2024-04-15T23:30:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 105/169 2024-04-15T23:30:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 35/169 2024-04-15T23:30:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 36/169 2024-04-15T23:30:03.356 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 106/169 2024-04-15T23:30:03.361 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/169 2024-04-15T23:30:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 38/169 2024-04-15T23:30:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/169 2024-04-15T23:30:03.616 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/169 2024-04-15T23:30:03.675 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/169 2024-04-15T23:30:04.194 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/169 2024-04-15T23:30:04.270 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/169 2024-04-15T23:30:04.363 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 44/169 2024-04-15T23:30:04.407 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:30:04.416 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:30:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/169 2024-04-15T23:30:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 47/169 2024-04-15T23:30:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 48/169 2024-04-15T23:30:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/169 2024-04-15T23:30:04.610 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 107/169 2024-04-15T23:30:04.688 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 108/169 2024-04-15T23:30:04.719 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 109/169 2024-04-15T23:30:04.750 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-16.el9.x86_64 110/169 2024-04-15T23:30:04.777 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 111/169 2024-04-15T23:30:04.843 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 50/169 2024-04-15T23:30:05.068 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 51/169 2024-04-15T23:30:05.092 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 112/169 2024-04-15T23:30:05.133 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:30:05.140 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 52/169 2024-04-15T23:30:05.184 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 53/169 2024-04-15T23:30:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:30:05.254 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 114/169 2024-04-15T23:30:05.290 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 115/169 2024-04-15T23:30:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 54/169 2024-04-15T23:30:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 55/169 2024-04-15T23:30:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 56/169 2024-04-15T23:30:05.497 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/169 2024-04-15T23:30:05.529 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 58/169 2024-04-15T23:30:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 59/169 2024-04-15T23:30:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/169 2024-04-15T23:30:05.658 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/169 2024-04-15T23:30:05.700 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 62/169 2024-04-15T23:30:05.751 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 116/169 2024-04-15T23:30:05.785 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:30:05.832 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 63/169 2024-04-15T23:30:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:30:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 64/169 2024-04-15T23:30:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 118/169 2024-04-15T23:30:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 65/169 2024-04-15T23:30:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 66/169 2024-04-15T23:30:06.126 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 67/169 2024-04-15T23:30:06.167 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/169 2024-04-15T23:30:06.192 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 69/169 2024-04-15T23:30:06.216 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 70/169 2024-04-15T23:30:06.311 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/169 2024-04-15T23:30:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 72/169 2024-04-15T23:30:06.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/169 2024-04-15T23:30:06.574 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 74/169 2024-04-15T23:30:06.623 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 75/169 2024-04-15T23:30:06.679 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 76/169 2024-04-15T23:30:06.862 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 77/169 2024-04-15T23:30:06.904 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 78/169 2024-04-15T23:30:07.030 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/169 2024-04-15T23:30:07.077 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 80/169 2024-04-15T23:30:07.108 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 81/169 2024-04-15T23:30:07.139 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 82/169 2024-04-15T23:30:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 83/169 2024-04-15T23:30:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 84/169 2024-04-15T23:30:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/169 2024-04-15T23:30:07.310 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/169 2024-04-15T23:30:07.344 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 87/169 2024-04-15T23:30:07.378 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 88/169 2024-04-15T23:30:07.411 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/169 2024-04-15T23:30:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/169 2024-04-15T23:30:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/169 2024-04-15T23:30:07.633 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 92/169 2024-04-15T23:30:07.677 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 93/169 2024-04-15T23:30:07.708 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/169 2024-04-15T23:30:07.755 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 95/169 2024-04-15T23:30:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 96/169 2024-04-15T23:30:07.901 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 97/169 2024-04-15T23:30:07.957 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-04-15T23:30:08.058 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/169 2024-04-15T23:30:08.093 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/169 2024-04-15T23:30:08.101 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:08.131 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:30:08.141 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/169 2024-04-15T23:30:08.150 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:08.191 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/169 2024-04-15T23:30:08.251 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/169 2024-04-15T23:30:08.292 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/169 2024-04-15T23:30:08.335 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/169 2024-04-15T23:30:08.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/169 2024-04-15T23:30:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/169 2024-04-15T23:30:08.675 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 99/169 2024-04-15T23:30:08.705 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:08.706 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/169 2024-04-15T23:30:08.708 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 100/169 2024-04-15T23:30:08.741 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 101/169 2024-04-15T23:30:08.745 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:30:08.761 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:08.837 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:30:08.837 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T23:30:08.837 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T23:30:08.837 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:08.871 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:08.882 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:08.904 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 102/169 2024-04-15T23:30:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 103/169 2024-04-15T23:30:09.020 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 104/169 2024-04-15T23:30:09.061 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:30:09.120 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/169 2024-04-15T23:30:09.148 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:09.234 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:09.257 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:30:09.313 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 15/169 2024-04-15T23:30:09.358 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 16/169 2024-04-15T23:30:09.381 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:30:09.397 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 17/169 2024-04-15T23:30:09.541 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-04-15T23:30:09.560 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-04-15T23:30:09.561 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:09.577 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 18/169 2024-04-15T23:30:09.624 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/169 2024-04-15T23:30:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 105/169 2024-04-15T23:30:09.725 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:09.732 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/169 2024-04-15T23:30:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:09.741 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:09.741 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T23:30:09.741 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:09.778 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 106/169 2024-04-15T23:30:09.825 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 21/169 2024-04-15T23:30:09.855 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 22/169 2024-04-15T23:30:09.892 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/169 2024-04-15T23:30:09.934 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/169 2024-04-15T23:30:10.008 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/169 2024-04-15T23:30:10.062 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/169 2024-04-15T23:30:10.101 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/169 2024-04-15T23:30:10.165 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 28/169 2024-04-15T23:30:10.200 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 29/169 2024-04-15T23:30:10.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 30/169 2024-04-15T23:30:10.277 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 31/169 2024-04-15T23:30:10.304 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 32/169 2024-04-15T23:30:10.373 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 33/169 2024-04-15T23:30:10.408 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 34/169 2024-04-15T23:30:10.444 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 35/169 2024-04-15T23:30:10.473 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 36/169 2024-04-15T23:30:10.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/169 2024-04-15T23:30:10.597 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-1.el9.noarch 38/169 2024-04-15T23:30:10.670 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/169 2024-04-15T23:30:10.803 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/169 2024-04-15T23:30:10.857 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/169 2024-04-15T23:30:10.997 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 107/169 2024-04-15T23:30:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 108/169 2024-04-15T23:30:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 109/169 2024-04-15T23:30:11.150 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jq-1.6-16.el9.x86_64 110/169 2024-04-15T23:30:11.178 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 111/169 2024-04-15T23:30:11.219 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:11.248 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:11.248 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T23:30:11.248 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:11.248 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:11.248 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:11.370 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/169 2024-04-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/169 2024-04-15T23:30:11.479 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:11.488 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 112/169 2024-04-15T23:30:11.503 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:11.503 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:11.503 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T23:30:11.503 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:11.503 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:11.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:11.524 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:30:11.549 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 44/169 2024-04-15T23:30:11.590 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:30:11.599 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 45/169 2024-04-15T23:30:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:30:11.646 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/169 2024-04-15T23:30:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 114/169 2024-04-15T23:30:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 115/169 2024-04-15T23:30:11.702 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 47/169 2024-04-15T23:30:11.733 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 48/169 2024-04-15T23:30:11.764 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 49/169 2024-04-15T23:30:11.956 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:11.980 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:11.980 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:11.980 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T23:30:11.981 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:11.981 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:11.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:12.056 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 50/169 2024-04-15T23:30:12.075 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 126/169 2024-04-15T23:30:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 116/169 2024-04-15T23:30:12.169 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:30:12.224 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:30:12.255 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 118/169 2024-04-15T23:30:12.276 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 51/169 2024-04-15T23:30:12.390 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 52/169 2024-04-15T23:30:12.433 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 53/169 2024-04-15T23:30:12.535 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:12.565 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:12.581 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 54/169 2024-04-15T23:30:12.596 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 128/169 2024-04-15T23:30:12.628 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 55/169 2024-04-15T23:30:12.674 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 129/169 2024-04-15T23:30:12.683 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 56/169 2024-04-15T23:30:12.721 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:12.752 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 57/169 2024-04-15T23:30:12.813 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 58/169 2024-04-15T23:30:12.849 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 59/169 2024-04-15T23:30:12.887 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 60/169 2024-04-15T23:30:12.932 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 61/169 2024-04-15T23:30:12.974 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 62/169 2024-04-15T23:30:13.106 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 63/169 2024-04-15T23:30:13.144 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 64/169 2024-04-15T23:30:13.184 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 65/169 2024-04-15T23:30:13.278 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 66/169 2024-04-15T23:30:13.419 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 67/169 2024-04-15T23:30:13.453 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 68/169 2024-04-15T23:30:13.478 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 69/169 2024-04-15T23:30:13.502 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 70/169 2024-04-15T23:30:13.582 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 71/169 2024-04-15T23:30:13.709 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 72/169 2024-04-15T23:30:13.747 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:13.790 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:13.826 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 73/169 2024-04-15T23:30:13.877 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 74/169 2024-04-15T23:30:13.925 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 75/169 2024-04-15T23:30:13.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 76/169 2024-04-15T23:30:14.171 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 77/169 2024-04-15T23:30:14.223 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 78/169 2024-04-15T23:30:14.385 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 79/169 2024-04-15T23:30:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:14.605 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 80/169 2024-04-15T23:30:14.636 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 81/169 2024-04-15T23:30:14.668 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 82/169 2024-04-15T23:30:14.696 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 83/169 2024-04-15T23:30:14.732 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 84/169 2024-04-15T23:30:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:14.762 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/169 2024-04-15T23:30:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:14.838 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/169 2024-04-15T23:30:14.881 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 87/169 2024-04-15T23:30:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:14.914 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 88/169 2024-04-15T23:30:14.956 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/169 2024-04-15T23:30:14.990 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/169 2024-04-15T23:30:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 133/169 2024-04-15T23:30:15.055 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:15.078 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/169 2024-04-15T23:30:15.097 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:30:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:15.160 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 92/169 2024-04-15T23:30:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:15.187 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:30:15.187 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T23:30:15.187 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T23:30:15.188 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:15.213 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 93/169 2024-04-15T23:30:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 136/169 2024-04-15T23:30:15.223 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:15.246 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/169 2024-04-15T23:30:15.291 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 95/169 2024-04-15T23:30:15.387 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 96/169 2024-04-15T23:30:15.437 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 97/169 2024-04-15T23:30:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/169 2024-04-15T23:30:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:16.144 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:16.144 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T23:30:16.144 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:16.144 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:16.154 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 98/169 2024-04-15T23:30:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:16.201 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 99/169 2024-04-15T23:30:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:16.211 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:16.211 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T23:30:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:16.235 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 100/169 2024-04-15T23:30:16.268 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 101/169 2024-04-15T23:30:16.445 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 102/169 2024-04-15T23:30:16.474 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 103/169 2024-04-15T23:30:16.513 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:16.536 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:16.536 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:16.536 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T23:30:16.536 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:16.536 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:16.536 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:16.561 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 104/169 2024-04-15T23:30:17.260 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 105/169 2024-04-15T23:30:17.361 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 106/169 2024-04-15T23:30:18.568 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 107/169 2024-04-15T23:30:18.650 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 108/169 2024-04-15T23:30:18.681 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 109/169 2024-04-15T23:30:18.705 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-16.el9.x86_64 110/169 2024-04-15T23:30:18.733 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 111/169 2024-04-15T23:30:19.045 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 112/169 2024-04-15T23:30:19.071 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:30:19.161 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 113/169 2024-04-15T23:30:19.192 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 114/169 2024-04-15T23:30:19.229 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 115/169 2024-04-15T23:30:19.686 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 116/169 2024-04-15T23:30:19.715 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:30:19.770 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 117/169 2024-04-15T23:30:19.792 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 118/169 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-04-15T23:30:20.406 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-04-15T23:30:20.407 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-04-15T23:30:20.407 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:20.576 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:20.591 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:20.591 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:20.591 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T23:30:20.591 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:20.958 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 141/169 2024-04-15T23:30:20.999 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 142/169 2024-04-15T23:30:21.029 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 143/169 2024-04-15T23:30:21.127 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:21.174 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 145/169 2024-04-15T23:30:21.207 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/169 2024-04-15T23:30:21.242 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 147/169 2024-04-15T23:30:21.275 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 148/169 2024-04-15T23:30:22.087 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:22.105 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/169 2024-04-15T23:30:22.114 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:22.114 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:22.114 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T23:30:22.114 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:22.114 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:22.114 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:22.175 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:22.185 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 150/169 2024-04-15T23:30:22.206 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:22.226 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 151/169 2024-04-15T23:30:22.323 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 152/169 2024-04-15T23:30:22.346 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:22.355 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 153/169 2024-04-15T23:30:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:22.369 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:22.369 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T23:30:22.369 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:22.369 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:22.369 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:22.380 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 154/169 2024-04-15T23:30:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 155/169 2024-04-15T23:30:22.407 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:22.484 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:22.520 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 157/169 2024-04-15T23:30:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 158/169 2024-04-15T23:30:22.550 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:22.635 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:22.669 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 160/169 2024-04-15T23:30:22.716 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 161/169 2024-04-15T23:30:22.745 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 119/169 2024-04-15T23:30:22.756 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 162/169 2024-04-15T23:30:22.781 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:22.784 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:30:22.807 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 164/169 2024-04-15T23:30:22.813 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:22.832 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:22.836 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:22.836 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:22.836 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T23:30:22.836 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:22.836 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:22.837 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:22.857 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 166/169 2024-04-15T23:30:22.859 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 120/169 2024-04-15T23:30:22.859 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-15T23:30:22.859 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-15T23:30:22.859 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:22.883 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:22.894 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:22.908 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/169 2024-04-15T23:30:22.940 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.2-8.el9.noarch 126/169 2024-04-15T23:30:22.974 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:23.426 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 128/169 2024-04-15T23:30:23.557 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 129/169 2024-04-15T23:30:23.587 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:24.618 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:24.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:25.623 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:25.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:25.756 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:25.927 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 133/169 2024-04-15T23:30:25.957 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:25.981 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:25.981 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T23:30:25.981 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:25.981 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:25.981 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:26.024 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:26.036 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:26.077 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 136/169 2024-04-15T23:30:26.939 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/169 2024-04-15T23:30:26.968 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:26.991 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:26.991 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:26.991 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T23:30:26.991 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:26.991 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:26.992 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:27.058 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:27.058 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T23:30:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:27.310 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:27.310 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-04-15T23:30:27.310 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-04-15T23:30:27.311 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-04-15T23:30:27.311 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-04-15T23:30:27.311 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-04-15T23:30:27.311 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-04-15T23:30:27.311 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-04-15T23:30:27.311 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:27.361 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:27.384 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:27.384 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:27.384 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T23:30:27.384 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:27.384 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:27.384 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:27.470 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:27.486 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:27.487 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:27.487 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T23:30:27.487 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/169 2024-04-15T23:30:28.089 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 13/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 15/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 16/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 18/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 19/169 2024-04-15T23:30:28.090 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 20/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 21/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 22/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 23/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 24/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 25/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 26/169 2024-04-15T23:30:28.091 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 27/169 2024-04-15T23:30:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 28/169 2024-04-15T23:30:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 29/169 2024-04-15T23:30:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 30/169 2024-04-15T23:30:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 31/169 2024-04-15T23:30:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 32/169 2024-04-15T23:30:28.105 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 33/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 34/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 35/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 36/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 40/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 41/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 42/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 43/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 44/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 45/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 46/169 2024-04-15T23:30:28.106 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 51/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 52/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 53/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 54/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 55/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 56/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 57/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 58/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 59/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 60/169 2024-04-15T23:30:28.107 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 61/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 62/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 63/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 64/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 65/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 66/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 67/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 68/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 69/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 70/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 71/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 72/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 73/169 2024-04-15T23:30:28.108 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 74/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 75/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 77/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 78/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 79/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 81/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 82/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 83/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 84/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-16.el9.x86_64 85/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/169 2024-04-15T23:30:28.109 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 89/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 90/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 91/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 92/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 93/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 94/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 95/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 96/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 97/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 98/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 99/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2024-04-15T23:30:28.110 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 104/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 105/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 106/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 107/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 108/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 109/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 110/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 111/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 112/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 113/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 115/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 116/169 2024-04-15T23:30:28.111 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 117/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 118/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 119/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 120/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 121/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 122/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 123/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 124/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 125/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 126/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 127/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 128/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 129/169 2024-04-15T23:30:28.112 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 130/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 131/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 132/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 133/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 134/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 135/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 136/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 137/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 139/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 141/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 142/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 143/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 145/169 2024-04-15T23:30:28.113 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 146/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 147/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 148/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 149/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 150/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 151/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 152/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 153/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 154/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 155/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 156/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 157/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 158/169 2024-04-15T23:30:28.114 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 160/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 162/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 164/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 166/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:28.115 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/169 2024-04-15T23:30:28.966 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:29.454 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:29.454 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T23:30:29.454 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:29.454 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:29.683 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:29.706 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:29.706 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:29.706 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T23:30:29.706 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:29.706 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:29.706 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 126/169 2024-04-15T23:30:30.187 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:30.217 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:30.248 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 128/169 2024-04-15T23:30:30.317 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 129/169 2024-04-15T23:30:30.348 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/169 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.839 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-04-15T23:30:30.840 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.841 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-04-15T23:30:30.842 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-16.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T23:30:30.843 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T23:30:30.844 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.845 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T23:30:30.846 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T23:30:30.847 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T23:30:30.848 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T23:30:30.849 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T23:30:30.850 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-15T23:30:30.851 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:30:30.851 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-04-15T23:30:31.267 DEBUG:teuthology.parallel:result is None 2024-04-15T23:30:31.379 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:31.425 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:31.814 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 141/169 2024-04-15T23:30:31.863 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 142/169 2024-04-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 143/169 2024-04-15T23:30:31.991 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:32.038 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 145/169 2024-04-15T23:30:32.071 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/169 2024-04-15T23:30:32.106 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 147/169 2024-04-15T23:30:32.139 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 148/169 2024-04-15T23:30:32.390 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:32.418 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:32.516 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:32.713 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 133/169 2024-04-15T23:30:32.745 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:32.768 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:32.768 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:32.768 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T23:30:32.768 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:32.769 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:32.769 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:32.813 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:32.823 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:32.874 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 136/169 2024-04-15T23:30:32.955 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/169 2024-04-15T23:30:33.041 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 150/169 2024-04-15T23:30:33.074 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 151/169 2024-04-15T23:30:33.166 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.4-9.el9.x86_64 152/169 2024-04-15T23:30:33.211 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.7.4-5.el9.x86_64 153/169 2024-04-15T23:30:33.237 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 154/169 2024-04-15T23:30:33.263 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 155/169 2024-04-15T23:30:33.263 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:33.340 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:33.376 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 157/169 2024-04-15T23:30:33.406 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 158/169 2024-04-15T23:30:33.406 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:33.504 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:33.542 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 160/169 2024-04-15T23:30:33.580 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 161/169 2024-04-15T23:30:33.611 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 162/169 2024-04-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:33.662 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 164/169 2024-04-15T23:30:33.687 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:33.713 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 166/169 2024-04-15T23:30:33.739 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:33.744 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/169 2024-04-15T23:30:33.763 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/169 2024-04-15T23:30:33.772 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T23:30:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:33.795 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:33.795 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:33.829 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:33.840 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T23:30:33.862 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:34.174 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:34.196 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:34.196 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T23:30:34.196 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:34.196 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:34.196 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 121/169 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-04-15T23:30:34.826 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:34.984 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:35.000 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 122/169 2024-04-15T23:30:35.000 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:35.000 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-15T23:30:35.000 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:36.443 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:36.470 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 123/169 2024-04-15T23:30:36.471 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:36.471 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-15T23:30:36.471 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:36.471 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-15T23:30:36.471 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:36.694 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:36.717 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 124/169 2024-04-15T23:30:36.717 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:36.717 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-15T23:30:36.717 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:36.717 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-15T23:30:36.717 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:37.153 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:37.176 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 125/169 2024-04-15T23:30:37.176 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:37.176 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-15T23:30:37.176 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:37.176 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-15T23:30:37.176 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:37.263 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 126/169 2024-04-15T23:30:37.631 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:37.661 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 127/169 2024-04-15T23:30:37.693 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 128/169 2024-04-15T23:30:37.753 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 129/169 2024-04-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:38.636 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 141/169 2024-04-15T23:30:38.677 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 142/169 2024-04-15T23:30:38.707 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 143/169 2024-04-15T23:30:38.804 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 130/169 2024-04-15T23:30:38.804 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 145/169 2024-04-15T23:30:38.845 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/169 2024-04-15T23:30:38.911 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 147/169 2024-04-15T23:30:38.944 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 148/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/169 2024-04-15T23:30:39.260 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 13/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 15/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 16/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 18/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 19/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 20/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 21/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 22/169 2024-04-15T23:30:39.261 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 23/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 24/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 25/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 26/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 27/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 28/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 29/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 30/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 31/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 32/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 33/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 34/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 35/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 36/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/169 2024-04-15T23:30:39.262 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.4-9.el9.x86_64 40/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 41/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 42/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 43/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 44/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 45/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 46/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-5.4.4-4.el9.x86_64 51/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 52/169 2024-04-15T23:30:39.263 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 53/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 54/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 55/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 56/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 57/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 58/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 59/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 60/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 61/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 62/169 2024-04-15T23:30:39.264 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 63/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 64/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 65/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 66/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 67/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 68/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 69/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 70/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 71/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 72/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 73/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 74/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 75/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 77/169 2024-04-15T23:30:39.265 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 78/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 79/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 81/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 82/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 83/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 84/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-16.el9.x86_64 85/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 89/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 90/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 91/169 2024-04-15T23:30:39.266 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 92/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 93/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 94/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 95/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 96/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 97/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 98/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 99/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 104/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 105/169 2024-04-15T23:30:39.267 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 106/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 107/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 108/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 109/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 110/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 111/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 112/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 113/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 115/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 116/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 117/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 118/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 119/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 120/169 2024-04-15T23:30:39.268 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 121/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 122/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 123/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 124/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 125/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 126/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 127/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 128/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 129/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 130/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 131/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 132/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 133/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 134/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 135/169 2024-04-15T23:30:39.269 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-3.el9.x86_64 136/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 137/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 139/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 141/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 142/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 143/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 145/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 146/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 147/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 148/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 149/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 150/169 2024-04-15T23:30:39.270 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 151/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 152/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 153/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 154/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 155/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 156/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 157/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 158/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 160/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 162/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 164/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:39.271 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 166/169 2024-04-15T23:30:39.272 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:39.272 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/169 2024-04-15T23:30:39.772 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/169 2024-04-15T23:30:39.806 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 131/169 2024-04-15T23:30:39.837 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:39.847 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 150/169 2024-04-15T23:30:39.897 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 151/169 2024-04-15T23:30:39.937 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 132/169 2024-04-15T23:30:39.989 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 152/169 2024-04-15T23:30:40.025 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 153/169 2024-04-15T23:30:40.051 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 154/169 2024-04-15T23:30:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 155/169 2024-04-15T23:30:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:40.099 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 133/169 2024-04-15T23:30:40.131 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:40.154 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 134/169 2024-04-15T23:30:40.154 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:40.154 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-15T23:30:40.154 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:40.154 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-15T23:30:40.154 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:40.179 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:40.207 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:40.216 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 157/169 2024-04-15T23:30:40.217 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 135/169 2024-04-15T23:30:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 158/169 2024-04-15T23:30:40.246 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:40.270 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 136/169 2024-04-15T23:30:40.339 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:40.373 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 160/169 2024-04-15T23:30:40.415 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 161/169 2024-04-15T23:30:40.452 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 162/169 2024-04-15T23:30:40.477 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:40.502 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 164/169 2024-04-15T23:30:40.528 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:40.544 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 166/169 2024-04-15T23:30:40.571 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:40.596 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/169 2024-04-15T23:30:40.661 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:41.133 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 137/169 2024-04-15T23:30:41.166 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:41.190 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:41.190 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:41.190 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-15T23:30:41.191 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:41.191 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-15T23:30:41.191 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:41.234 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:41.256 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 139/169 2024-04-15T23:30:41.256 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:41.256 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-15T23:30:41.256 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:41.568 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:41.591 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:41.591 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-15T23:30:41.591 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-15T23:30:41.591 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:41.591 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-15T23:30:41.591 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:42.080 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/169 2024-04-15T23:30:42.080 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:42.080 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:42.081 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.2-8.el9.noarch 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.7.4-5.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.082 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.083 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.4-9.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T23:30:42.084 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-16.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T23:30:42.085 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T23:30:42.086 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.087 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T23:30:42.088 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T23:30:42.089 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.090 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T23:30:42.091 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-15T23:30:42.092 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T23:30:42.093 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-15T23:30:42.093 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:30:42.093 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-15T23:30:42.549 DEBUG:teuthology.parallel:result is None 2024-04-15T23:30:45.808 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:45.809 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 13/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 15/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 16/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 18/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 19/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 20/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 21/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 22/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 23/169 2024-04-15T23:30:45.810 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 24/169 2024-04-15T23:30:45.811 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 25/169 2024-04-15T23:30:45.811 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 26/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 27/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 28/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 29/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 30/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 31/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 32/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 33/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 34/169 2024-04-15T23:30:45.826 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 35/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 36/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 40/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 41/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 42/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 43/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 44/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 45/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 46/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/169 2024-04-15T23:30:45.827 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 51/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 52/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 53/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 54/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 55/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 56/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 57/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 58/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 59/169 2024-04-15T23:30:45.828 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 60/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 61/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 62/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 63/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 64/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 65/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 66/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 67/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 68/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 69/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 70/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 71/169 2024-04-15T23:30:45.829 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 72/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 73/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 74/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 75/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 77/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 78/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 79/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 81/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 82/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 83/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 84/169 2024-04-15T23:30:45.830 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jq-1.6-16.el9.x86_64 85/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 89/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 90/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 91/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 92/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 93/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 94/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 95/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 96/169 2024-04-15T23:30:45.831 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 97/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 98/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 99/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 104/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 105/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 106/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 107/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 108/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 109/169 2024-04-15T23:30:45.832 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 110/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 111/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 112/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 113/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 115/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 116/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 117/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 118/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 119/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 120/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 121/169 2024-04-15T23:30:45.833 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 122/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 123/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 124/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 125/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 126/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 127/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 128/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 129/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 130/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 131/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 132/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 133/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 134/169 2024-04-15T23:30:45.834 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 135/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 136/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 137/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 139/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 141/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 142/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 143/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 145/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 146/169 2024-04-15T23:30:45.835 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 147/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 148/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 149/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 150/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 151/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 152/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 153/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 154/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 155/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 156/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 157/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 158/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/169 2024-04-15T23:30:45.836 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 160/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 162/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 164/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 166/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:45.837 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/169 2024-04-15T23:30:46.021 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 141/169 2024-04-15T23:30:46.071 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 142/169 2024-04-15T23:30:46.110 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 143/169 2024-04-15T23:30:46.214 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:46.263 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 145/169 2024-04-15T23:30:46.295 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/169 2024-04-15T23:30:46.330 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 147/169 2024-04-15T23:30:46.355 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 148/169 2024-04-15T23:30:47.185 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/169 2024-04-15T23:30:47.265 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 150/169 2024-04-15T23:30:47.307 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 151/169 2024-04-15T23:30:47.406 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 152/169 2024-04-15T23:30:47.443 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 153/169 2024-04-15T23:30:47.477 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 154/169 2024-04-15T23:30:47.503 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 155/169 2024-04-15T23:30:47.504 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:47.589 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/169 2024-04-15T23:30:47.625 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 157/169 2024-04-15T23:30:47.655 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 158/169 2024-04-15T23:30:47.656 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:47.737 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 159/169 2024-04-15T23:30:47.774 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 160/169 2024-04-15T23:30:47.812 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 161/169 2024-04-15T23:30:47.844 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 162/169 2024-04-15T23:30:47.870 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:47.895 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 164/169 2024-04-15T23:30:47.929 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:47.954 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 166/169 2024-04-15T23:30:47.980 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:48.005 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/169 2024-04-15T23:30:48.070 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:48.765 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/169 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.766 INFO:teuthology.orchestra.run.smithi107.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T23:30:48.767 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.768 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T23:30:48.769 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: jq-1.6-16.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T23:30:48.770 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T23:30:48.771 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T23:30:48.772 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T23:30:48.773 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T23:30:48.774 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T23:30:48.775 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T23:30:48.776 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T23:30:48.777 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-15T23:30:48.778 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:30:48.778 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-04-15T23:30:49.174 DEBUG:teuthology.parallel:result is None 2024-04-15T23:30:53.291 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 169/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 1/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 3/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 4/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2114.ga9a75 5/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 6/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 7/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 8/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 9/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 10/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 11/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 12/169 2024-04-15T23:30:53.292 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_ 13/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 14/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 15/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_6 16/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86 17/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 18/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el 19/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.0.0-2114.ga9a752df.el7. 20/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_6 21/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 22/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 23/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 24/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 25/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 26/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 27/169 2024-04-15T23:30:53.293 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df. 28/169 2024-04-15T23:30:53.294 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noa 29/169 2024-04-15T23:30:53.294 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.n 30/169 2024-04-15T23:30:53.294 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a 31/169 2024-04-15T23:30:53.309 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el 32/169 2024-04-15T23:30:53.309 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 33/169 2024-04-15T23:30:53.309 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.e 34/169 2024-04-15T23:30:53.309 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 35/169 2024-04-15T23:30:53.309 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 36/169 2024-04-15T23:30:53.309 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 37/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 38/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 39/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 40/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 41/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 42/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 43/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 44/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 45/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 46/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/169 2024-04-15T23:30:53.310 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 51/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 52/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 53/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 54/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 55/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 56/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 57/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 58/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 59/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 60/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 61/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 62/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 63/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 64/169 2024-04-15T23:30:53.311 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 65/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 66/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 67/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 68/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 69/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 70/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 71/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 72/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 73/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 74/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 75/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 77/169 2024-04-15T23:30:53.312 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 78/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 79/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 81/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 82/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 83/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 84/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-16.el9.x86_64 85/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 86/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 87/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 88/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 89/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 90/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 91/169 2024-04-15T23:30:53.313 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 92/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 93/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 94/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 95/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 96/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 97/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 98/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 99/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 104/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 105/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 106/169 2024-04-15T23:30:53.314 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 107/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 108/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 109/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 110/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 111/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 112/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 113/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 115/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 116/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 117/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 118/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 119/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 120/169 2024-04-15T23:30:53.315 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 121/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 122/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 123/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 124/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 125/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 126/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 127/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 128/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 129/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 130/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 131/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 132/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 133/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 134/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 135/169 2024-04-15T23:30:53.316 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 136/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 137/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 138/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 139/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 140/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 141/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 142/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 143/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 144/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 145/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 146/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 147/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 148/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 149/169 2024-04-15T23:30:53.317 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 150/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 151/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 152/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 153/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 154/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 155/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 156/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 157/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 158/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 159/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 160/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 161/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 162/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 163/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 164/169 2024-04-15T23:30:53.318 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 165/169 2024-04-15T23:30:53.319 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 166/169 2024-04-15T23:30:53.319 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 167/169 2024-04-15T23:30:53.319 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 168/169 2024-04-15T23:30:56.260 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 169/169 2024-04-15T23:30:56.260 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:56.260 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-04-15T23:30:56.260 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-15T23:30:56.260 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.261 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.262 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.0.0-2114.ga9a752df.el7.noarch 2024-04-15T23:30:56.263 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-16.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.264 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-15T23:30:56.265 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-15T23:30:56.266 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-15T23:30:56.267 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-15T23:30:56.268 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-15T23:30:56.269 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-15T23:30:56.270 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.0.0-2114.ga9a752df.el7.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-15T23:30:56.271 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-15T23:30:56.272 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:30:56.272 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-04-15T23:30:56.717 DEBUG:teuthology.parallel:result is None 2024-04-15T23:30:56.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:30:56.867 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T23:30:56.894 INFO:teuthology.orchestra.run.smithi102.stdout:19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:56.894 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:56.894 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-15T23:30:56.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:30:57.044 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T23:30:57.070 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:57.070 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:57.070 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-15T23:30:57.072 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:30:57.208 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T23:30:57.235 INFO:teuthology.orchestra.run.smithi115.stdout:19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:57.235 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:57.235 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-15T23:30:57.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a9a752df26c63acad72e1b3569fd79a515ca0765 2024-04-15T23:30:57.372 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-15T23:30:57.394 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:57.394 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2114.ga9a752df.el7 2024-04-15T23:30:57.394 INFO:teuthology.task.install:The correct ceph version 19.0.0-2114.ga9a752df is installed. 2024-04-15T23:30:57.396 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-15T23:30:57.396 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:30:57.396 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T23:30:57.432 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:30:57.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T23:30:57.469 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:30:57.469 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T23:30:57.506 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:30:57.506 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-15T23:30:57.537 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-15T23:30:57.537 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:30:57.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T23:30:57.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T23:30:57.641 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:30:57.641 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T23:30:57.675 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T23:30:57.748 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:30:57.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T23:30:57.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T23:30:57.852 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:30:57.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-04-15T23:30:57.880 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-15T23:30:57.948 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-15T23:30:57.949 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:30:57.949 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T23:30:57.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T23:30:58.053 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:30:58.053 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T23:30:58.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T23:30:58.158 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:30:58.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T23:30:58.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T23:30:58.257 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:30:58.257 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-15T23:30:58.287 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-15T23:30:58.355 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-15T23:30:58.356 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:30:58.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T23:30:58.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T23:30:58.457 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:30:58.457 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T23:30:58.491 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T23:30:58.562 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:30:58.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T23:30:58.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T23:30:58.661 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:30:58.661 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-04-15T23:30:58.691 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-15T23:30:58.760 INFO:teuthology.run_tasks:Running task ceph... 2024-04-15T23:30:58.852 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-15T23:30:58.852 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-04-15T23:30:58.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-04-15T23:30:58.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-04-15T23:30:58.859 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-04-15T23:30:58.888 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-15T23:30:58.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T23:30:58.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T23:30:58.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T23:30:58.931 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-15T23:30:58.960 INFO:tasks.ceph:Creating extra log directories... 2024-04-15T23:30:58.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T23:30:58.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T23:30:59.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T23:30:59.003 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-15T23:30:59.045 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-15T23:30:59.045 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-15T23:30:59.046 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'branch': 'squid', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7657659', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '461a84e6fbbf089011eafd13b98169fb9e9b8cc9'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 4286, 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '461a84e6fbbf089011eafd13b98169fb9e9b8cc9', 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLN/72GoCFriHKlyrdZVw/LdEz3dUx834w+2cx7NLTjKBrEAny5jo1VZjCXTQVczjIyQj4AOA8O4CKiRShUQUP4=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8e3tEe5X1UTLxmj184KS+lctC4v2gex0rXpKXUJRBdtcmBrNXDrQ7e5abae1crWzMM2UHTIjrNUET0OQwgP1A=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKJ/VR8YskKUNlKlpbgC+MoDBAX2u4amTrTWtQwffLPPh/IsGUxNqXxAVpHebJXumOEQvPg5atV+2C5TG3gLIXM=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXzIbTpoWupgp/B0wH0rH2O3cg7qAhRffdOCdtmffkpk4nUbuq/DrP1ZSYMFh7nztFVRyBxY4mtGqQ+mZ/hLhY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsx.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-15_21:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-15T23:30:59.046 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T23:30:59.059 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T23:30:59.075 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T23:30:59.078 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-15T23:30:59.093 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T23:30:59.113 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T23:30:59.133 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T23:30:59.135 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T23:30:59.162 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:30:59.163 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T23:30:59.219 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T23:30:59.219 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-15 23:30:41.081973281 +0000 2024-04-15T23:30:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-15 23:28:26.619685245 +0000 2024-04-15T23:30:59.277 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-15 23:28:26.619685245 +0000 2024-04-15T23:30:59.277 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-15 23:28:26.619685245 +0000 2024-04-15T23:30:59.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T23:30:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-15T23:30:59.345 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-15T23:30:59.346 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000299051 s, 1.7 MB/s 2024-04-15T23:30:59.347 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T23:30:59.405 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-04-15T23:30:59.460 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-15 23:30:41.082973265 +0000 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-15 23:28:26.957679764 +0000 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-15 23:28:26.957679764 +0000 2024-04-15T23:30:59.461 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-15 23:28:26.957679764 +0000 2024-04-15T23:30:59.461 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T23:30:59.528 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-15T23:30:59.528 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-15T23:30:59.528 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000198081 s, 2.6 MB/s 2024-04-15T23:30:59.529 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T23:30:59.586 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-04-15T23:30:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T23:30:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:30:59.642 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-15T23:30:59.643 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:30:59.643 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:30:59.643 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-15 23:30:41.082973265 +0000 2024-04-15T23:30:59.643 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-15 23:28:27.305674121 +0000 2024-04-15T23:30:59.643 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-15 23:28:27.305674121 +0000 2024-04-15T23:30:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-15 23:28:27.305674121 +0000 2024-04-15T23:30:59.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T23:30:59.709 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-15T23:30:59.710 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-15T23:30:59.710 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000199018 s, 2.6 MB/s 2024-04-15T23:30:59.711 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T23:30:59.767 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-04-15T23:30:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T23:30:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:30:59.823 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-15T23:30:59.823 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:30:59.823 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:30:59.823 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-15 23:30:41.083973249 +0000 2024-04-15T23:30:59.824 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-15 23:28:27.641668673 +0000 2024-04-15T23:30:59.824 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-15 23:28:27.641668673 +0000 2024-04-15T23:30:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-04-15 23:28:27.641668673 +0000 2024-04-15T23:30:59.824 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T23:30:59.890 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-15T23:30:59.891 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-15T23:30:59.891 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000206963 s, 2.5 MB/s 2024-04-15T23:30:59.892 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T23:30:59.947 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-15T23:30:59.948 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:30:59.948 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T23:30:59.964 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T23:30:59.965 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-04-15T23:31:00.021 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-15 23:30:34.194362499 +0000 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-15 23:28:28.152146160 +0000 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-15 23:28:28.152146160 +0000 2024-04-15T23:31:00.093 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-15 23:28:28.152146160 +0000 2024-04-15T23:31:00.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T23:31:00.121 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-15T23:31:00.122 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-15T23:31:00.122 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000244097 s, 2.1 MB/s 2024-04-15T23:31:00.123 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T23:31:00.179 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-15 23:30:34.194362499 +0000 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-15 23:28:28.479139899 +0000 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-15 23:28:28.479139899 +0000 2024-04-15T23:31:00.235 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-15 23:28:28.479139899 +0000 2024-04-15T23:31:00.236 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T23:31:00.302 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-15T23:31:00.303 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-15T23:31:00.303 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000203169 s, 2.5 MB/s 2024-04-15T23:31:00.304 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T23:31:00.361 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-15 23:30:34.195362480 +0000 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-15 23:28:28.823133313 +0000 2024-04-15T23:31:00.417 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-15 23:28:28.823133313 +0000 2024-04-15T23:31:00.418 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-15 23:28:28.823133313 +0000 2024-04-15T23:31:00.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T23:31:00.484 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-15T23:31:00.484 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-15T23:31:00.484 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000266426 s, 1.9 MB/s 2024-04-15T23:31:00.485 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T23:31:00.542 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-15 23:30:34.195362480 +0000 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-15 23:28:29.180126478 +0000 2024-04-15T23:31:00.597 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-15 23:28:29.180126478 +0000 2024-04-15T23:31:00.598 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-15 23:28:29.180126478 +0000 2024-04-15T23:31:00.598 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T23:31:00.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-15T23:31:00.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-15T23:31:00.664 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000228764 s, 2.2 MB/s 2024-04-15T23:31:00.665 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T23:31:00.722 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-15T23:31:00.722 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:31:00.722 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-04-15T23:31:00.741 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-15T23:31:00.742 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-04-15T23:31:00.799 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-15T23:31:00.799 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-15 23:30:48.452790333 +0000 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-15 23:28:27.403809592 +0000 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-15 23:28:27.403809592 +0000 2024-04-15T23:31:00.800 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-15 23:28:27.403809592 +0000 2024-04-15T23:31:00.800 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-15T23:31:00.869 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-15T23:31:00.870 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-15T23:31:00.870 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000118357 s, 4.3 MB/s 2024-04-15T23:31:00.871 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-15T23:31:00.929 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-15 23:30:48.452790333 +0000 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-15 23:28:27.746802723 +0000 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-15 23:28:27.746802723 +0000 2024-04-15T23:31:00.986 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-15 23:28:27.746802723 +0000 2024-04-15T23:31:00.986 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-15T23:31:01.054 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-15T23:31:01.054 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-15T23:31:01.054 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.5857e-05 s, 6.0 MB/s 2024-04-15T23:31:01.055 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-15T23:31:01.112 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-15 23:30:48.452790333 +0000 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-15 23:28:28.074796155 +0000 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-15 23:28:28.074796155 +0000 2024-04-15T23:31:01.169 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-15 23:28:28.074796155 +0000 2024-04-15T23:31:01.169 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-15T23:31:01.236 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-15T23:31:01.236 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-15T23:31:01.236 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.3997e-05 s, 6.1 MB/s 2024-04-15T23:31:01.238 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-15T23:31:01.295 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-04-15 23:30:48.453790313 +0000 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-04-15 23:28:28.414789346 +0000 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-04-15 23:28:28.414789346 +0000 2024-04-15T23:31:01.351 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-04-15 23:28:28.414789346 +0000 2024-04-15T23:31:01.352 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-15T23:31:01.418 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-04-15T23:31:01.419 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-04-15T23:31:01.419 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000108891 s, 4.7 MB/s 2024-04-15T23:31:01.420 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-15T23:31:01.477 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-15T23:31:01.477 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-15T23:31:01.477 INFO:tasks.ceph:Generating config... 2024-04-15T23:31:01.479 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-15T23:31:01.479 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-15T23:31:01.479 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-15T23:31:01.479 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-15T23:31:01.479 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-15T23:31:01.479 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-15T23:31:01.479 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-15T23:31:01.480 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-15T23:31:01.481 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-15T23:31:01.481 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-15T23:31:01.481 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-15T23:31:01.481 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-15T23:31:01.481 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-15T23:31:01.481 INFO:tasks.ceph:Setting up mon.a... 2024-04-15T23:31:01.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-15T23:31:01.541 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2024-04-15T23:31:01.544 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-15T23:31:01.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T23:31:01.620 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102'), ('mon.b', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]'), ('mon.c', '[v2:172.21.15.102:3302,v1:172.21.15.102:6791]')] 2024-04-15T23:31:01.620 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],[v2:172.21.15.102:3302,v1:172.21.15.102:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-15T23:31:01.621 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:01.621 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T23:31:01.676 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --addv b '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --addv c '[v2:172.21.15.102:3302,v1:172.21.15.102:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:01.763 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:01.763 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = quincy 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2024-04-15T23:31:01.780645+0000 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-04-15T23:31:01.780645+0000 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 17 (quincy) 2024-04-15T23:31:01.764 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2024-04-15T23:31:01.765 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-04-15T23:31:01.765 INFO:teuthology.orchestra.run.smithi102.stdout:1: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.b 2024-04-15T23:31:01.765 INFO:teuthology.orchestra.run.smithi102.stdout:2: [v2:172.21.15.102:3302/0,v1:172.21.15.102:6791/0] mon.c 2024-04-15T23:31:01.765 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-15T23:31:01.766 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-15T23:31:01.781 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 60f632e8-f087-41df-a0b6-043b99131bd6... 2024-04-15T23:31:01.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T23:31:01.824 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T23:31:01.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T23:31:01.829 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-15T23:31:01.874 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-04-15T23:31:01.874 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-04-15T23:31:01.874 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T23:31:01.874 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T23:31:01.875 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.876 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],[v2:172.21.15.102:3302,v1:172.21.15.102:6791]" 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.877 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.878 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = stupid 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-04-15T23:31:01.879 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: osd blocked scrub grace period = 3600 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: osd max markdown count = 1000 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-15T23:31:01.880 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.881 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.882 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-04-15T23:31:01.883 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],[v2:172.21.15.102:3302,v1:172.21.15.102:6791]" 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-04-15T23:31:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = stupid 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-04-15T23:31:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: osd blocked scrub grace period = 3600 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: osd max markdown count = 1000 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-15T23:31:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-04-15T23:31:01.893 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-04-15T23:31:01.894 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-04-15T23:31:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-04-15T23:31:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-04-15T23:31:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T23:31:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],[v2:172.21.15.102:3302,v1:172.21.15.102:6791]" 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.897 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug trim objects = true 2024-04-15T23:31:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-04-15T23:31:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: bdev async discard = True 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: bdev enable discard = True 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore allocator = stupid 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 1/20 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 1/20 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 4/10 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd blocked scrub grace period = 3600 2024-04-15T23:31:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd max markdown count = 1000 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-04-15T23:31:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T23:31:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.904 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-04-15T23:31:01.905 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.906 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-04-15T23:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-04-15T23:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-04-15T23:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-04-15T23:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],[v2:172.21.15.102:3302,v1:172.21.15.102:6791]" 2024-04-15T23:31:01.910 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-04-15T23:31:01.911 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-04-15T23:31:01.912 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = stupid 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: osd blocked scrub grace period = 3600 2024-04-15T23:31:01.913 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: osd max markdown count = 1000 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-04-15T23:31:01.914 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.915 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-15T23:31:01.916 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-04-15T23:31:01.917 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-04-15T23:31:01.917 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-04-15T23:31:01.917 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-04-15T23:31:01.919 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-15T23:31:01.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-15T23:31:02.015 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-15T23:31:02.015 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:02.015 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-15T23:31:02.031 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:02.031 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-15T23:31:02.086 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-04-15T23:31:02.087 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:02.087 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T23:31:02.087 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T23:31:02.169 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:02.169 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:02.224 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-04-15T23:31:02.224 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:31:02.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T23:31:02.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T23:31:02.267 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:31:02.268 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:02.323 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:31:02.323 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:31:02.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T23:31:02.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T23:31:02.371 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:31:02.371 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:02.430 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:31:02.430 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:31:02.430 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-15T23:31:02.430 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-15T23:31:02.478 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:31:02.478 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:02.536 INFO:tasks.ceph:Setting up mon nodes... 2024-04-15T23:31:02.536 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-15T23:31:02.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T23:31:02.595 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-15T23:31:02.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T23:31:02.655 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-15T23:31:02.658 INFO:tasks.ceph:Setting up mds nodes... 2024-04-15T23:31:02.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-15T23:31:02.714 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-15T23:31:02.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-15T23:31:02.745 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-15T23:31:02.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-15T23:31:02.830 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-15T23:31:02.846 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-15T23:31:02.846 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-15T23:31:02.846 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-15T23:31:02.876 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-15T23:31:02.876 INFO:tasks.ceph:role: osd.0 2024-04-15T23:31:02.876 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-04-15T23:31:02.877 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T23:31:02.951 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T23:31:02.951 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T23:31:02.952 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T23:31:03.445 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-04-15T23:31:03.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-04-15T23:31:03.448 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-15T23:31:03.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-15T23:31:03.609 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:03.709 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-15T23:31:03.725+0000 7f0881414640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-15T23:31:03.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-15T23:31:03.726+0000 7f0881414640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-15T23:31:03.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-15T23:31:03.726+0000 7f0881414640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T23:31:03.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-15T23:31:03.726+0000 7f0881414640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T23:31:03.710 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-15T23:31:03.726+0000 7f0881414640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-15T23:31:03.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-15T23:31:03.735+0000 7f0881414640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-15T23:31:06.558 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-15T23:31:06.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-15T23:31:06.620 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-15T23:31:06.620 INFO:tasks.ceph:role: osd.1 2024-04-15T23:31:06.620 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:31:06.621 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T23:31:06.700 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T23:31:06.701 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T23:31:07.211 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-04-15T23:31:07.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-04-15T23:31:07.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-15T23:31:07.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-15T23:31:07.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:07.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-15T23:31:07.515+0000 7f77f8eae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-15T23:31:07.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-15T23:31:07.516+0000 7f77f8eae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-15T23:31:07.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-15T23:31:07.516+0000 7f77f8eae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T23:31:07.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-15T23:31:07.516+0000 7f77f8eae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T23:31:07.500 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-15T23:31:07.516+0000 7f77f8eae640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-15T23:31:07.504 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-15T23:31:07.520+0000 7f77f8eae640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-15T23:31:10.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-15T23:31:10.397 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-15T23:31:10.431 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-15T23:31:10.431 INFO:tasks.ceph:role: osd.2 2024-04-15T23:31:10.431 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:31:10.432 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-15T23:31:10.503 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-15T23:31:10.504 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-15T23:31:10.537 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-04-15T23:31:10.539 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-04-15T23:31:10.539 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-15T23:31:10.614 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-15T23:31:10.687 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:10.808 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-15T23:31:10.824+0000 7f2c5820d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-15T23:31:10.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-15T23:31:10.824+0000 7f2c5820d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-15T23:31:10.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-15T23:31:10.824+0000 7f2c5820d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T23:31:10.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-15T23:31:10.824+0000 7f2c5820d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T23:31:10.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-15T23:31:10.824+0000 7f2c5820d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-15T23:31:10.809 INFO:teuthology.orchestra.run.smithi195.stderr:2024-04-15T23:31:10.825+0000 7f2c5820d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-15T23:31:13.654 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-15T23:31:13.685 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-15T23:31:13.685 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:13.685 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-15T23:31:13.719 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:13.719 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-15T23:31:13.792 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:13.792 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-15T23:31:13.864 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:31:13.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-15T23:31:13.898 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:31:13.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-15T23:31:13.931 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:31:13.932 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-15T23:31:13.964 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:31:13.964 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-15T23:31:13.983 INFO:tasks.ceph:Adding keys to all mons... 2024-04-15T23:31:13.983 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-15T23:31:14.054 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-04-15T23:31:14.054 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC2uB1mLcCFJBAA7OMEujtMaUdY38QBL0NtBg== 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC2uB1mcc8fKBAAa07IBIV1mx0c5wCai8gUpA== 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC2uB1mMRGnKxAAHFkPd43gDS76HibLpS/UhQ== 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC3uB1mw2NLKxAA0kxcYQpAKZz+1HrKi145BA== 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC7uB1m12XFHhAAqhYtHl+5J1zsI7P6VyhU7A== 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC+uB1mHW8xMRAA/1x8jMOTgzRCj8DO/3fKmg== 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-04-15T23:31:14.055 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC2uB1mfeaFMhAAFAw2hycJW127APMzOLaG+g== 2024-04-15T23:31:14.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T23:31:14.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-15T23:31:14.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-15T23:31:14.269 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T23:31:14.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T23:31:14.378 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-15T23:31:14.432 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-15T23:31:14.488 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-15T23:31:14.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-15T23:31:14.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T23:31:14.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-15T23:31:14.653 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-15T23:31:14.721 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T23:31:14.820 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-15T23:31:14.848 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-15T23:31:14.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-15T23:31:15.018 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-15T23:31:15.046 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-15T23:31:15.101 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-15T23:31:15.102 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-15T23:31:15.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-15T23:31:15.144 INFO:tasks.ceph.mon.a:Started 2024-04-15T23:31:15.144 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-15T23:31:15.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-15T23:31:15.146 INFO:tasks.ceph.mon.b:Started 2024-04-15T23:31:15.146 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-15T23:31:15.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-15T23:31:15.148 INFO:tasks.ceph.mon.c:Started 2024-04-15T23:31:15.148 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-15T23:31:15.149 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-15T23:31:15.149 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-15T23:31:15.150 INFO:tasks.ceph.mgr.x:Started 2024-04-15T23:31:15.151 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-15T23:31:15.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-15T23:31:15.155 INFO:tasks.ceph.mgr.y:Started 2024-04-15T23:31:15.155 INFO:tasks.ceph:Setting crush tunables to default 2024-04-15T23:31:15.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2024-04-15T23:31:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-04-15T23:31:15.592 INFO:tasks.ceph:check_enable_crimson: False 2024-04-15T23:31:15.592 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-15T23:31:15.593 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-15T23:31:15.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-15T23:31:15.625 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-15T23:31:15.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-15T23:31:15.659 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-04-15T23:31:15.659 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-15T23:31:15.692 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 37ee61ed-86ab-4308-a161-cd2aafcfd4f9 0 2024-04-15T23:31:15.925 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-04-15T23:31:15.936 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 9631dded-d96a-40ad-945d-252291b498da 1 2024-04-15T23:31:16.009 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.025+0000 7f77a6c38040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T23:31:16.009 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.025+0000 7f0f3c642040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-15T23:31:16.066 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.082+0000 7f77a6c38040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T23:31:16.066 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.082+0000 7f0f3c642040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-15T23:31:16.117 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-04-15T23:31:16.128 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 45415c3c-3208-4cab-b6d2-75f250746bef 2 2024-04-15T23:31:16.310 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-04-15T23:31:16.321 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-15T23:31:16.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-15T23:31:16.324 INFO:tasks.ceph.osd.0:Started 2024-04-15T23:31:16.324 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-15T23:31:16.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-15T23:31:16.327 INFO:tasks.ceph.osd.1:Started 2024-04-15T23:31:16.327 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-15T23:31:16.327 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-15T23:31:16.329 INFO:tasks.ceph.osd.2:Started 2024-04-15T23:31:16.330 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:16.530 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:16.531 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:16.326489+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:16.547 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-15T23:31:16.547 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-15T23:31:16.639 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.656+0000 7f77a6c38040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T23:31:16.640 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.656+0000 7f0f3c642040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-15T23:31:16.696 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.712+0000 7f77a6c38040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T23:31:16.697 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.713+0000 7f0f3c642040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-15T23:31:16.742 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.759+0000 7f77a6c38040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T23:31:16.743 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.760+0000 7f0f3c642040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-15T23:31:16.799 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.815+0000 7f77a6c38040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T23:31:16.799 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.815+0000 7f0f3c642040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-15T23:31:16.843 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.859+0000 7f0f3c642040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T23:31:16.843 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.859+0000 7f77a6c38040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-15T23:31:16.849 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:16.926 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:16.942+0000 7f8d7a411640 -1 Falling back to public interface 2024-04-15T23:31:16.926 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:16.942+0000 7f9e97206640 -1 Falling back to public interface 2024-04-15T23:31:16.927 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:16.942+0000 7f145bc48640 -1 Falling back to public interface 2024-04-15T23:31:16.966 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:16.983+0000 7f77a6c38040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T23:31:16.967 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:16.983+0000 7f0f3c642040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-15T23:31:17.013 INFO:teuthology.misc.health.smithi102.stdout: 2024-04-15T23:31:17.013 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":5,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:16.326489+0000","last_up_change":"0.000000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:17.024 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-15T23:31:17.040 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.057+0000 7f77a6c38040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T23:31:17.041 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.057+0000 7f0f3c642040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-15T23:31:17.089 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.105+0000 7f77a6c38040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T23:31:17.089 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.105+0000 7f0f3c642040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-15T23:31:17.143 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.160+0000 7f77a6c38040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T23:31:17.144 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.160+0000 7f0f3c642040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-15T23:31:17.193 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.209+0000 7f77a6c38040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T23:31:17.193 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.209+0000 7f0f3c642040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-15T23:31:17.587 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.603+0000 7f77a6c38040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T23:31:17.587 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.603+0000 7f0f3c642040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-15T23:31:17.723 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.739+0000 7f77a6c38040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T23:31:17.723 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.739+0000 7f0f3c642040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-15T23:31:17.840 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.856+0000 7f77a6c38040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T23:31:17.840 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.856+0000 7f0f3c642040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-15T23:31:17.886 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:17.903+0000 7f77a6c38040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T23:31:17.887 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:17.903+0000 7f0f3c642040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-15T23:31:18.000 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:18.016+0000 7f77a6c38040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T23:31:18.000 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:18.017+0000 7f0f3c642040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-15T23:31:18.096 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:18.113+0000 7f77a6c38040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T23:31:18.097 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:18.113+0000 7f0f3c642040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-15T23:31:18.253 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:18.270+0000 7f77a6c38040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T23:31:18.254 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:18.270+0000 7f0f3c642040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-15T23:31:18.296 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:18.312+0000 7f77a6c38040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T23:31:18.296 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:18.313+0000 7f0f3c642040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-15T23:31:18.459 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:18.475+0000 7f77a6c38040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T23:31:18.459 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:18.476+0000 7f0f3c642040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-15T23:31:19.285 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:19.301+0000 7f77a6c38040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T23:31:19.286 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:19.301+0000 7f0f3c642040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-15T23:31:19.569 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:19.585+0000 7f77a6c38040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T23:31:19.569 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:19.585+0000 7f0f3c642040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-15T23:31:19.622 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:19.639+0000 7f0f3c642040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T23:31:19.623 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:19.639+0000 7f77a6c38040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-15T23:31:19.742 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:19.758+0000 7f77a6c38040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T23:31:19.742 INFO:tasks.ceph.mgr.y.smithi102.stderr:2024-04-15T23:31:19.759+0000 7f0f3c642040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-15T23:31:20.353 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:20.369+0000 7f8d7a411640 -1 osd.2 0 log_to_monitors true 2024-04-15T23:31:20.354 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:20.371+0000 7f145bc48640 -1 osd.1 0 log_to_monitors true 2024-04-15T23:31:20.361 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:20.377+0000 7f9e97206640 -1 osd.0 0 log_to_monitors true 2024-04-15T23:31:20.758 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:20.774+0000 7f7747837640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-15T23:31:20.758 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-04-15T23:31:20.774+0000 7f7747837640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-15T23:31:22.556 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:22.572+0000 7f8d754ec640 -1 osd.2 0 waiting for initial osdmap 2024-04-15T23:31:22.570 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:22.587+0000 7f8d6db1e640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T23:31:22.754 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:22.770+0000 7f9e92979640 -1 osd.0 0 waiting for initial osdmap 2024-04-15T23:31:22.769 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:22.785+0000 7f9e8afab640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T23:31:22.792 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:22.808+0000 7f14573bb640 -1 osd.1 0 waiting for initial osdmap 2024-04-15T23:31:22.805 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:22.822+0000 7f144f9ed640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T23:31:23.328 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:23.614 INFO:teuthology.misc.health.smithi102.stdout: 2024-04-15T23:31:23.614 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":8,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:23.575432+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:23.625 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-15T23:31:23.625 INFO:tasks.ceph:Creating RBD pool 2024-04-15T23:31:23.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-15T23:31:24.565 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'rbd' created 2024-04-15T23:31:24.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-15T23:31:25.566 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-15T23:31:25.582 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-15T23:31:25.583 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-15T23:31:25.583 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-15T23:31:25.585 INFO:tasks.ceph.mds.a:Started 2024-04-15T23:31:25.585 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-15T23:31:25.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:25.670 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-04-15T23:31:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:25.886 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":10,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:25.577518+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:25.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T23:31:25.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T23:31:26.198 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-04-15T23:31:26.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-15T23:31:26.508 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 8 2024-04-15T23:31:26.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:31:26.852 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:26.852 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4218,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-15T23:31:26.852 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 2 2024-04-15T23:31:26.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:27.151 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:27.151 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":11,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:26.578551+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:27.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T23:31:27.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T23:31:27.449 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-04-15T23:31:27.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-15T23:31:27.745 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 8 2024-04-15T23:31:27.758 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-15T23:31:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:28.044 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-04-15T23:31:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2024-04-15T23:31:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2024-04-15T23:31:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:28.044 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 2, 2024-04-15T23:31:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": "rbd" 2024-04-15T23:31:28.045 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:28.045 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-04-15T23:31:28.056 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-15T23:31:28.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-15T23:31:28.840 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2024-04-15T23:31:28.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-15T23:31:29.847 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2024-04-15T23:31:29.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-15T23:31:30.845 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 3 and data pool 4 2024-04-15T23:31:30.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:31.172 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:31.173 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:30.206179+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:31.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:31.472 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:31.473 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":14,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:30.206179+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:31.485 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-15T23:31:31.872 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-15T23:31:31.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-15T23:31:32.881 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-15T23:31:32.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:31:33.201 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:33.201 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T23:31:30.206590+0000","modified":"2024-04-15T23:31:32.213535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4218,"qdb_cluster":[4218]},"id":1}]} 2024-04-15T23:31:33.201 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-04-15T23:31:33.214 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:33.499 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:33.499 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:31.867515+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:33.512 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-15T23:31:33.512 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:33.803 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:33.805 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:33.813 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-15T23:31:33.768644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91644,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023876,"statfs":{"total":289910292480,"available":289816449024,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374425+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:27.374425+0000","last_peered":"2024-04-15T23:31:27.374425+0000","last_clean":"2024-04-15T23:31:27.374425+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:27.374425+0000","last_undegraded":"2024-04-15T23:31:27.374425+0000","last_fullsized":"2024-04-15T23:31:27.374425+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374445+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:27.374445+0000","last_peered":"2024-04-15T23:31:27.374445+0000","last_clean":"2024-04-15T23:31:27.374445+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:27.374445+0000","last_undegraded":"2024-04-15T23:31:27.374445+0000","last_fullsized":"2024-04-15T23:31:27.374445+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374364+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:27.374364+0000","last_peered":"2024-04-15T23:31:27.374364+0000","last_clean":"2024-04-15T23:31:27.374364+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:27.374364+0000","last_undegraded":"2024-04-15T23:31:27.374364+0000","last_fullsized":"2024-04-15T23:31:27.374364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585756+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:26.585756+0000","last_peered":"2024-04-15T23:31:26.585756+0000","last_clean":"2024-04-15T23:31:26.585756+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:26.585756+0000","last_undegraded":"2024-04-15T23:31:26.585756+0000","last_fullsized":"2024-04-15T23:31:26.585756+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374434+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:27.374434+0000","last_peered":"2024-04-15T23:31:27.374434+0000","last_clean":"2024-04-15T23:31:27.374434+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:27.374434+0000","last_undegraded":"2024-04-15T23:31:27.374434+0000","last_fullsized":"2024-04-15T23:31:27.374434+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585771+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:26.585771+0000","last_peered":"2024-04-15T23:31:26.585771+0000","last_clean":"2024-04-15T23:31:26.585771+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:26.585771+0000","last_undegraded":"2024-04-15T23:31:26.585771+0000","last_fullsized":"2024-04-15T23:31:26.585771+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374314+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:27.374314+0000","last_peered":"2024-04-15T23:31:27.374314+0000","last_clean":"2024-04-15T23:31:27.374314+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:27.374314+0000","last_undegraded":"2024-04-15T23:31:27.374314+0000","last_fullsized":"2024-04-15T23:31:27.374314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585772+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:26.585772+0000","last_peered":"2024-04-15T23:31:26.585772+0000","last_clean":"2024-04-15T23:31:26.585772+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:26.585772+0000","last_undegraded":"2024-04-15T23:31:26.585772+0000","last_fullsized":"2024-04-15T23:31:26.585772+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374439+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:27.374439+0000","last_peered":"2024-04-15T23:31:27.374439+0000","last_clean":"2024-04-15T23:31:27.374439+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:27.374439+0000","last_undegraded":"2024-04-15T23:31:27.374439+0000","last_fullsized":"2024-04-15T23:31:27.374439+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:33.818 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:34.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:34.143 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:34.152 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-15T23:31:33.768644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91644,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023876,"statfs":{"total":289910292480,"available":289816449024,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374425+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:27.374425+0000","last_peered":"2024-04-15T23:31:27.374425+0000","last_clean":"2024-04-15T23:31:27.374425+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:27.374425+0000","last_undegraded":"2024-04-15T23:31:27.374425+0000","last_fullsized":"2024-04-15T23:31:27.374425+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374445+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:27.374445+0000","last_peered":"2024-04-15T23:31:27.374445+0000","last_clean":"2024-04-15T23:31:27.374445+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:27.374445+0000","last_undegraded":"2024-04-15T23:31:27.374445+0000","last_fullsized":"2024-04-15T23:31:27.374445+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374364+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:27.374364+0000","last_peered":"2024-04-15T23:31:27.374364+0000","last_clean":"2024-04-15T23:31:27.374364+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:27.374364+0000","last_undegraded":"2024-04-15T23:31:27.374364+0000","last_fullsized":"2024-04-15T23:31:27.374364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585756+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:26.585756+0000","last_peered":"2024-04-15T23:31:26.585756+0000","last_clean":"2024-04-15T23:31:26.585756+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:26.585756+0000","last_undegraded":"2024-04-15T23:31:26.585756+0000","last_fullsized":"2024-04-15T23:31:26.585756+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374434+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:27.374434+0000","last_peered":"2024-04-15T23:31:27.374434+0000","last_clean":"2024-04-15T23:31:27.374434+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:27.374434+0000","last_undegraded":"2024-04-15T23:31:27.374434+0000","last_fullsized":"2024-04-15T23:31:27.374434+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585771+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:26.585771+0000","last_peered":"2024-04-15T23:31:26.585771+0000","last_clean":"2024-04-15T23:31:26.585771+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:26.585771+0000","last_undegraded":"2024-04-15T23:31:26.585771+0000","last_fullsized":"2024-04-15T23:31:26.585771+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374314+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:27.374314+0000","last_peered":"2024-04-15T23:31:27.374314+0000","last_clean":"2024-04-15T23:31:27.374314+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:27.374314+0000","last_undegraded":"2024-04-15T23:31:27.374314+0000","last_fullsized":"2024-04-15T23:31:27.374314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585772+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:26.585772+0000","last_peered":"2024-04-15T23:31:26.585772+0000","last_clean":"2024-04-15T23:31:26.585772+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:26.585772+0000","last_undegraded":"2024-04-15T23:31:26.585772+0000","last_fullsized":"2024-04-15T23:31:26.585772+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374439+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:27.374439+0000","last_peered":"2024-04-15T23:31:27.374439+0000","last_clean":"2024-04-15T23:31:27.374439+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:27.374439+0000","last_undegraded":"2024-04-15T23:31:27.374439+0000","last_fullsized":"2024-04-15T23:31:27.374439+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:34.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:34.480 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:34.482 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:34.491 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-15T23:31:33.768644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91644,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023876,"statfs":{"total":289910292480,"available":289816449024,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374425+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:27.374425+0000","last_peered":"2024-04-15T23:31:27.374425+0000","last_clean":"2024-04-15T23:31:27.374425+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:27.374425+0000","last_undegraded":"2024-04-15T23:31:27.374425+0000","last_fullsized":"2024-04-15T23:31:27.374425+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374445+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:27.374445+0000","last_peered":"2024-04-15T23:31:27.374445+0000","last_clean":"2024-04-15T23:31:27.374445+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:27.374445+0000","last_undegraded":"2024-04-15T23:31:27.374445+0000","last_fullsized":"2024-04-15T23:31:27.374445+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374364+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:27.374364+0000","last_peered":"2024-04-15T23:31:27.374364+0000","last_clean":"2024-04-15T23:31:27.374364+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:27.374364+0000","last_undegraded":"2024-04-15T23:31:27.374364+0000","last_fullsized":"2024-04-15T23:31:27.374364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585756+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:26.585756+0000","last_peered":"2024-04-15T23:31:26.585756+0000","last_clean":"2024-04-15T23:31:26.585756+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:26.585756+0000","last_undegraded":"2024-04-15T23:31:26.585756+0000","last_fullsized":"2024-04-15T23:31:26.585756+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374434+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:27.374434+0000","last_peered":"2024-04-15T23:31:27.374434+0000","last_clean":"2024-04-15T23:31:27.374434+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:27.374434+0000","last_undegraded":"2024-04-15T23:31:27.374434+0000","last_fullsized":"2024-04-15T23:31:27.374434+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585771+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:26.585771+0000","last_peered":"2024-04-15T23:31:26.585771+0000","last_clean":"2024-04-15T23:31:26.585771+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:26.585771+0000","last_undegraded":"2024-04-15T23:31:26.585771+0000","last_fullsized":"2024-04-15T23:31:26.585771+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374314+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:27.374314+0000","last_peered":"2024-04-15T23:31:27.374314+0000","last_clean":"2024-04-15T23:31:27.374314+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:27.374314+0000","last_undegraded":"2024-04-15T23:31:27.374314+0000","last_fullsized":"2024-04-15T23:31:27.374314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585772+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:26.585772+0000","last_peered":"2024-04-15T23:31:26.585772+0000","last_clean":"2024-04-15T23:31:26.585772+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:26.585772+0000","last_undegraded":"2024-04-15T23:31:26.585772+0000","last_fullsized":"2024-04-15T23:31:26.585772+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374439+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:27.374439+0000","last_peered":"2024-04-15T23:31:27.374439+0000","last_clean":"2024-04-15T23:31:27.374439+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:27.374439+0000","last_undegraded":"2024-04-15T23:31:27.374439+0000","last_fullsized":"2024-04-15T23:31:27.374439+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:34.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-15T23:31:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-15T23:31:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-15T23:31:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-15T23:31:34.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-15T23:31:34.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-15T23:31:34.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-15T23:31:34.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-15T23:31:34.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-15T23:31:34.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-15T23:31:34.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-15T23:31:34.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-15T23:31:34.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-15T23:31:34.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-15T23:31:34.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-15T23:31:34.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-15T23:31:34.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-15T23:31:34.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-15T23:31:34.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-15T23:31:34.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-15T23:31:34.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-15T23:31:34.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-15T23:31:34.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-15T23:31:34.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-15T23:31:34.515 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:29.854434+0000', 'last_change': '2024-04-15T23:31:29.854434+0000', 'last_active': '2024-04-15T23:31:29.854434+0000', 'last_peered': '2024-04-15T23:31:29.854434+0000', 'last_clean': '2024-04-15T23:31:29.854434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:29.854434+0000', 'last_undegraded': '2024-04-15T23:31:29.854434+0000', 'last_fullsized': '2024-04-15T23:31:29.854434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:29.854434+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.516 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-15T23:31:34.516 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-15T23:31:28.849203+0000', 'last_change': '2024-04-15T23:31:28.849203+0000', 'last_active': '2024-04-15T23:31:28.849203+0000', 'last_peered': '2024-04-15T23:31:28.849203+0000', 'last_clean': '2024-04-15T23:31:28.849203+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-15T23:31:28.849203+0000', 'last_undegraded': '2024-04-15T23:31:28.849203+0000', 'last_fullsized': '2024-04-15T23:31:28.849203+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'last_clean_scrub_stamp': '2024-04-15T23:31:28.849203+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-15T23:31:34.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-15T23:31:34.881 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:34.881 INFO:teuthology.orchestra.run.smithi102.stdout:{"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":19,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":15,"num_osds":3,"num_up_osds":3,"osd_up_since":1713223883,"num_in_osds":3,"osd_in_since":1713223876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":93843456,"bytes_avail":289816449024,"bytes_total":289910292480,"unknown_pgs_ratio":0.91428571939468384},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4218}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-15T23:31:15.485437+0000","services":{}},"progress_events":{}} 2024-04-15T23:31:34.894 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-15T23:31:34.894 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:35.183 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:35.184 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:35.194 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-15T23:31:33.768644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":91644,"kb_used_data":1448,"kb_used_omap":4,"kb_used_meta":89339,"kb_avail":283023876,"statfs":{"total":289910292480,"available":289816449024,"internally_reserved":0,"allocated":1482752,"data_stored":1264088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":91483471},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914110"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":208,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374425+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:27.374425+0000","last_peered":"2024-04-15T23:31:27.374425+0000","last_clean":"2024-04-15T23:31:27.374425+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:27.374425+0000","last_undegraded":"2024-04-15T23:31:27.374425+0000","last_fullsized":"2024-04-15T23:31:27.374425+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374445+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:27.374445+0000","last_peered":"2024-04-15T23:31:27.374445+0000","last_clean":"2024-04-15T23:31:27.374445+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:27.374445+0000","last_undegraded":"2024-04-15T23:31:27.374445+0000","last_fullsized":"2024-04-15T23:31:27.374445+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374364+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:27.374364+0000","last_peered":"2024-04-15T23:31:27.374364+0000","last_clean":"2024-04-15T23:31:27.374364+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:27.374364+0000","last_undegraded":"2024-04-15T23:31:27.374364+0000","last_fullsized":"2024-04-15T23:31:27.374364+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585756+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:26.585756+0000","last_peered":"2024-04-15T23:31:26.585756+0000","last_clean":"2024-04-15T23:31:26.585756+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:26.585756+0000","last_undegraded":"2024-04-15T23:31:26.585756+0000","last_fullsized":"2024-04-15T23:31:26.585756+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374434+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:27.374434+0000","last_peered":"2024-04-15T23:31:27.374434+0000","last_clean":"2024-04-15T23:31:27.374434+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:27.374434+0000","last_undegraded":"2024-04-15T23:31:27.374434+0000","last_fullsized":"2024-04-15T23:31:27.374434+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585771+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:26.585771+0000","last_peered":"2024-04-15T23:31:26.585771+0000","last_clean":"2024-04-15T23:31:26.585771+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:26.585771+0000","last_undegraded":"2024-04-15T23:31:26.585771+0000","last_fullsized":"2024-04-15T23:31:26.585771+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374314+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:27.374314+0000","last_peered":"2024-04-15T23:31:27.374314+0000","last_clean":"2024-04-15T23:31:27.374314+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:27.374314+0000","last_undegraded":"2024-04-15T23:31:27.374314+0000","last_fullsized":"2024-04-15T23:31:27.374314+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:26.585772+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:26.585772+0000","last_peered":"2024-04-15T23:31:26.585772+0000","last_clean":"2024-04-15T23:31:26.585772+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:26.585772+0000","last_undegraded":"2024-04-15T23:31:26.585772+0000","last_fullsized":"2024-04-15T23:31:26.585772+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-04-15T23:31:27.374439+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:27.374439+0000","last_peered":"2024-04-15T23:31:27.374439+0000","last_clean":"2024-04-15T23:31:27.374439+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:27.374439+0000","last_undegraded":"2024-04-15T23:31:27.374439+0000","last_fullsized":"2024-04-15T23:31:27.374439+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:29.854434+0000","last_change":"2024-04-15T23:31:29.854434+0000","last_active":"2024-04-15T23:31:29.854434+0000","last_peered":"2024-04-15T23:31:29.854434+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:29.854434+0000","last_undegraded":"2024-04-15T23:31:29.854434+0000","last_fullsized":"2024-04-15T23:31:29.854434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-15T23:31:28.849203+0000","last_change":"2024-04-15T23:31:28.849203+0000","last_active":"2024-04-15T23:31:28.849203+0000","last_peered":"2024-04-15T23:31:28.849203+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-15T23:31:28.849203+0000","last_undegraded":"2024-04-15T23:31:28.849203+0000","last_fullsized":"2024-04-15T23:31:28.849203+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31280,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340560,"statfs":{"total":96636764160,"available":96604733440,"internally_reserved":0,"allocated":98304,"data_stored":27784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":692224,"data_stored":618152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:36.677 INFO:tasks.ceph.mds.a.smithi102.stderr:2024-04-15T23:31:36.693+0000 7fa51f3e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-15T23:31:38.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:38.500 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:38.502 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:38.511 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-15T23:31:37.769581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.907799"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882232+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:31.882232+0000","last_peered":"2024-04-15T23:31:31.882232+0000","last_clean":"2024-04-15T23:31:31.882232+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:31.882232+0000","last_undegraded":"2024-04-15T23:31:31.882232+0000","last_fullsized":"2024-04-15T23:31:31.882232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881959+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:31.881959+0000","last_peered":"2024-04-15T23:31:31.881959+0000","last_clean":"2024-04-15T23:31:31.881959+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:31.881959+0000","last_undegraded":"2024-04-15T23:31:31.881959+0000","last_fullsized":"2024-04-15T23:31:31.881959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873116+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:32.873116+0000","last_peered":"2024-04-15T23:31:32.873116+0000","last_clean":"2024-04-15T23:31:32.873116+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:32.873116+0000","last_undegraded":"2024-04-15T23:31:32.873116+0000","last_fullsized":"2024-04-15T23:31:32.873116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872895+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:32.872895+0000","last_peered":"2024-04-15T23:31:32.872895+0000","last_clean":"2024-04-15T23:31:32.872895+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:32.872895+0000","last_undegraded":"2024-04-15T23:31:32.872895+0000","last_fullsized":"2024-04-15T23:31:32.872895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881576+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:31.881576+0000","last_peered":"2024-04-15T23:31:31.881576+0000","last_clean":"2024-04-15T23:31:31.881576+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:31.881576+0000","last_undegraded":"2024-04-15T23:31:31.881576+0000","last_fullsized":"2024-04-15T23:31:31.881576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872413+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:32.872413+0000","last_peered":"2024-04-15T23:31:32.872413+0000","last_clean":"2024-04-15T23:31:32.872413+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:32.872413+0000","last_undegraded":"2024-04-15T23:31:32.872413+0000","last_fullsized":"2024-04-15T23:31:32.872413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872547+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:32.872547+0000","last_peered":"2024-04-15T23:31:32.872547+0000","last_clean":"2024-04-15T23:31:32.872547+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:32.872547+0000","last_undegraded":"2024-04-15T23:31:32.872547+0000","last_fullsized":"2024-04-15T23:31:32.872547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872247+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:32.872247+0000","last_peered":"2024-04-15T23:31:32.872247+0000","last_clean":"2024-04-15T23:31:32.872247+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:32.872247+0000","last_undegraded":"2024-04-15T23:31:32.872247+0000","last_fullsized":"2024-04-15T23:31:32.872247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869374+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:32.869374+0000","last_peered":"2024-04-15T23:31:32.869374+0000","last_clean":"2024-04-15T23:31:32.869374+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:32.869374+0000","last_undegraded":"2024-04-15T23:31:32.869374+0000","last_fullsized":"2024-04-15T23:31:32.869374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881987+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:31.881987+0000","last_peered":"2024-04-15T23:31:31.881987+0000","last_clean":"2024-04-15T23:31:31.881987+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:31.881987+0000","last_undegraded":"2024-04-15T23:31:31.881987+0000","last_fullsized":"2024-04-15T23:31:31.881987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873095+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:32.873095+0000","last_peered":"2024-04-15T23:31:32.873095+0000","last_clean":"2024-04-15T23:31:32.873095+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:32.873095+0000","last_undegraded":"2024-04-15T23:31:32.873095+0000","last_fullsized":"2024-04-15T23:31:32.873095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881697+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:31.881697+0000","last_peered":"2024-04-15T23:31:31.881697+0000","last_clean":"2024-04-15T23:31:31.881697+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:31.881697+0000","last_undegraded":"2024-04-15T23:31:31.881697+0000","last_fullsized":"2024-04-15T23:31:31.881697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881360+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:31.881360+0000","last_peered":"2024-04-15T23:31:31.881360+0000","last_clean":"2024-04-15T23:31:31.881360+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:31.881360+0000","last_undegraded":"2024-04-15T23:31:31.881360+0000","last_fullsized":"2024-04-15T23:31:31.881360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872570+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:32.872570+0000","last_peered":"2024-04-15T23:31:32.872570+0000","last_clean":"2024-04-15T23:31:32.872570+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:32.872570+0000","last_undegraded":"2024-04-15T23:31:32.872570+0000","last_fullsized":"2024-04-15T23:31:32.872570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872656+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:32.872656+0000","last_peered":"2024-04-15T23:31:32.872656+0000","last_clean":"2024-04-15T23:31:32.872656+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:32.872656+0000","last_undegraded":"2024-04-15T23:31:32.872656+0000","last_fullsized":"2024-04-15T23:31:32.872656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872467+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:32.872467+0000","last_peered":"2024-04-15T23:31:32.872467+0000","last_clean":"2024-04-15T23:31:32.872467+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:32.872467+0000","last_undegraded":"2024-04-15T23:31:32.872467+0000","last_fullsized":"2024-04-15T23:31:32.872467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869858+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:32.869858+0000","last_peered":"2024-04-15T23:31:32.869858+0000","last_clean":"2024-04-15T23:31:32.869858+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:32.869858+0000","last_undegraded":"2024-04-15T23:31:32.869858+0000","last_fullsized":"2024-04-15T23:31:32.869858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882220+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:31.882220+0000","last_peered":"2024-04-15T23:31:31.882220+0000","last_clean":"2024-04-15T23:31:31.882220+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:31.882220+0000","last_undegraded":"2024-04-15T23:31:31.882220+0000","last_fullsized":"2024-04-15T23:31:31.882220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869019+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:32.869019+0000","last_peered":"2024-04-15T23:31:32.869019+0000","last_clean":"2024-04-15T23:31:32.869019+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:32.869019+0000","last_undegraded":"2024-04-15T23:31:32.869019+0000","last_fullsized":"2024-04-15T23:31:32.869019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873131+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:32.873131+0000","last_peered":"2024-04-15T23:31:32.873131+0000","last_clean":"2024-04-15T23:31:32.873131+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:32.873131+0000","last_undegraded":"2024-04-15T23:31:32.873131+0000","last_fullsized":"2024-04-15T23:31:32.873131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873464+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:32.873464+0000","last_peered":"2024-04-15T23:31:32.873464+0000","last_clean":"2024-04-15T23:31:32.873464+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:32.873464+0000","last_undegraded":"2024-04-15T23:31:32.873464+0000","last_fullsized":"2024-04-15T23:31:32.873464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881386+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:31.881386+0000","last_peered":"2024-04-15T23:31:31.881386+0000","last_clean":"2024-04-15T23:31:31.881386+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:31.881386+0000","last_undegraded":"2024-04-15T23:31:31.881386+0000","last_fullsized":"2024-04-15T23:31:31.881386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868278+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:32.868278+0000","last_peered":"2024-04-15T23:31:32.868278+0000","last_clean":"2024-04-15T23:31:32.868278+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:32.868278+0000","last_undegraded":"2024-04-15T23:31:32.868278+0000","last_fullsized":"2024-04-15T23:31:32.868278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.880945+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:31.880945+0000","last_peered":"2024-04-15T23:31:31.880945+0000","last_clean":"2024-04-15T23:31:31.880945+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:31.880945+0000","last_undegraded":"2024-04-15T23:31:31.880945+0000","last_fullsized":"2024-04-15T23:31:31.880945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882304+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:31.882304+0000","last_peered":"2024-04-15T23:31:31.882304+0000","last_clean":"2024-04-15T23:31:31.882304+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:31.882304+0000","last_undegraded":"2024-04-15T23:31:31.882304+0000","last_fullsized":"2024-04-15T23:31:31.882304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869414+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869414+0000","last_peered":"2024-04-15T23:31:32.869414+0000","last_clean":"2024-04-15T23:31:32.869414+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:32.869414+0000","last_undegraded":"2024-04-15T23:31:32.869414+0000","last_fullsized":"2024-04-15T23:31:32.869414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873492+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:32.873492+0000","last_peered":"2024-04-15T23:31:32.873492+0000","last_clean":"2024-04-15T23:31:32.873492+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:32.873492+0000","last_undegraded":"2024-04-15T23:31:32.873492+0000","last_fullsized":"2024-04-15T23:31:32.873492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881984+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:31.881984+0000","last_peered":"2024-04-15T23:31:31.881984+0000","last_clean":"2024-04-15T23:31:31.881984+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:31.881984+0000","last_undegraded":"2024-04-15T23:31:31.881984+0000","last_fullsized":"2024-04-15T23:31:31.881984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869197+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:32.869197+0000","last_peered":"2024-04-15T23:31:32.869197+0000","last_clean":"2024-04-15T23:31:32.869197+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:32.869197+0000","last_undegraded":"2024-04-15T23:31:32.869197+0000","last_fullsized":"2024-04-15T23:31:32.869197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881682+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:31.881682+0000","last_peered":"2024-04-15T23:31:31.881682+0000","last_clean":"2024-04-15T23:31:31.881682+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:31.881682+0000","last_undegraded":"2024-04-15T23:31:31.881682+0000","last_fullsized":"2024-04-15T23:31:31.881682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868338+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:32.868338+0000","last_peered":"2024-04-15T23:31:32.868338+0000","last_clean":"2024-04-15T23:31:32.868338+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:32.868338+0000","last_undegraded":"2024-04-15T23:31:32.868338+0000","last_fullsized":"2024-04-15T23:31:32.868338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872437+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:32.872437+0000","last_peered":"2024-04-15T23:31:32.872437+0000","last_clean":"2024-04-15T23:31:32.872437+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:32.872437+0000","last_undegraded":"2024-04-15T23:31:32.872437+0000","last_fullsized":"2024-04-15T23:31:32.872437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881756+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:31.881756+0000","last_peered":"2024-04-15T23:31:31.881756+0000","last_clean":"2024-04-15T23:31:31.881756+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:31.881756+0000","last_undegraded":"2024-04-15T23:31:31.881756+0000","last_fullsized":"2024-04-15T23:31:31.881756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873498+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:32.873498+0000","last_peered":"2024-04-15T23:31:32.873498+0000","last_clean":"2024-04-15T23:31:32.873498+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:32.873498+0000","last_undegraded":"2024-04-15T23:31:32.873498+0000","last_fullsized":"2024-04-15T23:31:32.873498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882157+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:31.882157+0000","last_peered":"2024-04-15T23:31:31.882157+0000","last_clean":"2024-04-15T23:31:31.882157+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:31.882157+0000","last_undegraded":"2024-04-15T23:31:31.882157+0000","last_fullsized":"2024-04-15T23:31:31.882157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868654+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:32.868654+0000","last_peered":"2024-04-15T23:31:32.868654+0000","last_clean":"2024-04-15T23:31:32.868654+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:32.868654+0000","last_undegraded":"2024-04-15T23:31:32.868654+0000","last_fullsized":"2024-04-15T23:31:32.868654+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869537+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869537+0000","last_peered":"2024-04-15T23:31:32.869537+0000","last_clean":"2024-04-15T23:31:32.869537+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:32.869537+0000","last_undegraded":"2024-04-15T23:31:32.869537+0000","last_fullsized":"2024-04-15T23:31:32.869537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881346+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:31.881346+0000","last_peered":"2024-04-15T23:31:31.881346+0000","last_clean":"2024-04-15T23:31:31.881346+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:31.881346+0000","last_undegraded":"2024-04-15T23:31:31.881346+0000","last_fullsized":"2024-04-15T23:31:31.881346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869351+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:32.869351+0000","last_peered":"2024-04-15T23:31:32.869351+0000","last_clean":"2024-04-15T23:31:32.869351+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:32.869351+0000","last_undegraded":"2024-04-15T23:31:32.869351+0000","last_fullsized":"2024-04-15T23:31:32.869351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872629+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:32.872629+0000","last_peered":"2024-04-15T23:31:32.872629+0000","last_clean":"2024-04-15T23:31:32.872629+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:32.872629+0000","last_undegraded":"2024-04-15T23:31:32.872629+0000","last_fullsized":"2024-04-15T23:31:32.872629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873206+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:32.873206+0000","last_peered":"2024-04-15T23:31:32.873206+0000","last_clean":"2024-04-15T23:31:32.873206+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:32.873206+0000","last_undegraded":"2024-04-15T23:31:32.873206+0000","last_fullsized":"2024-04-15T23:31:32.873206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881005+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:31.881005+0000","last_peered":"2024-04-15T23:31:31.881005+0000","last_clean":"2024-04-15T23:31:31.881005+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:31.881005+0000","last_undegraded":"2024-04-15T23:31:31.881005+0000","last_fullsized":"2024-04-15T23:31:31.881005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882332+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:31.882332+0000","last_peered":"2024-04-15T23:31:31.882332+0000","last_clean":"2024-04-15T23:31:31.882332+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:31.882332+0000","last_undegraded":"2024-04-15T23:31:31.882332+0000","last_fullsized":"2024-04-15T23:31:31.882332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881199+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:31.881199+0000","last_peered":"2024-04-15T23:31:31.881199+0000","last_clean":"2024-04-15T23:31:31.881199+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:31.881199+0000","last_undegraded":"2024-04-15T23:31:31.881199+0000","last_fullsized":"2024-04-15T23:31:31.881199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873620+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:32.873620+0000","last_peered":"2024-04-15T23:31:32.873620+0000","last_clean":"2024-04-15T23:31:32.873620+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:32.873620+0000","last_undegraded":"2024-04-15T23:31:32.873620+0000","last_fullsized":"2024-04-15T23:31:32.873620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872743+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:32.872743+0000","last_peered":"2024-04-15T23:31:32.872743+0000","last_clean":"2024-04-15T23:31:32.872743+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:32.872743+0000","last_undegraded":"2024-04-15T23:31:32.872743+0000","last_fullsized":"2024-04-15T23:31:32.872743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873389+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:32.873389+0000","last_peered":"2024-04-15T23:31:32.873389+0000","last_clean":"2024-04-15T23:31:32.873389+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:32.873389+0000","last_undegraded":"2024-04-15T23:31:32.873389+0000","last_fullsized":"2024-04-15T23:31:32.873389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868888+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:32.868888+0000","last_peered":"2024-04-15T23:31:32.868888+0000","last_clean":"2024-04-15T23:31:32.868888+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:32.868888+0000","last_undegraded":"2024-04-15T23:31:32.868888+0000","last_fullsized":"2024-04-15T23:31:32.868888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869420+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:32.869420+0000","last_peered":"2024-04-15T23:31:32.869420+0000","last_clean":"2024-04-15T23:31:32.869420+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:32.869420+0000","last_undegraded":"2024-04-15T23:31:32.869420+0000","last_fullsized":"2024-04-15T23:31:32.869420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873238+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:32.873238+0000","last_peered":"2024-04-15T23:31:32.873238+0000","last_clean":"2024-04-15T23:31:32.873238+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:32.873238+0000","last_undegraded":"2024-04-15T23:31:32.873238+0000","last_fullsized":"2024-04-15T23:31:32.873238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873205+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:32.873205+0000","last_peered":"2024-04-15T23:31:32.873205+0000","last_clean":"2024-04-15T23:31:32.873205+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:32.873205+0000","last_undegraded":"2024-04-15T23:31:32.873205+0000","last_fullsized":"2024-04-15T23:31:32.873205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873417+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:32.873417+0000","last_peered":"2024-04-15T23:31:32.873417+0000","last_clean":"2024-04-15T23:31:32.873417+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:32.873417+0000","last_undegraded":"2024-04-15T23:31:32.873417+0000","last_fullsized":"2024-04-15T23:31:32.873417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881379+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:31.881379+0000","last_peered":"2024-04-15T23:31:31.881379+0000","last_clean":"2024-04-15T23:31:31.881379+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:31.881379+0000","last_undegraded":"2024-04-15T23:31:31.881379+0000","last_fullsized":"2024-04-15T23:31:31.881379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873159+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:32.873159+0000","last_peered":"2024-04-15T23:31:32.873159+0000","last_clean":"2024-04-15T23:31:32.873159+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:32.873159+0000","last_undegraded":"2024-04-15T23:31:32.873159+0000","last_fullsized":"2024-04-15T23:31:32.873159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881106+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:31.881106+0000","last_peered":"2024-04-15T23:31:31.881106+0000","last_clean":"2024-04-15T23:31:31.881106+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:31.881106+0000","last_undegraded":"2024-04-15T23:31:31.881106+0000","last_fullsized":"2024-04-15T23:31:31.881106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869573+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:32.869573+0000","last_peered":"2024-04-15T23:31:32.869573+0000","last_clean":"2024-04-15T23:31:32.869573+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:32.869573+0000","last_undegraded":"2024-04-15T23:31:32.869573+0000","last_fullsized":"2024-04-15T23:31:32.869573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873127+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:32.873127+0000","last_peered":"2024-04-15T23:31:32.873127+0000","last_clean":"2024-04-15T23:31:32.873127+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:32.873127+0000","last_undegraded":"2024-04-15T23:31:32.873127+0000","last_fullsized":"2024-04-15T23:31:32.873127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873569+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:32.873569+0000","last_peered":"2024-04-15T23:31:32.873569+0000","last_clean":"2024-04-15T23:31:32.873569+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:32.873569+0000","last_undegraded":"2024-04-15T23:31:32.873569+0000","last_fullsized":"2024-04-15T23:31:32.873569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868860+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:32.868860+0000","last_peered":"2024-04-15T23:31:32.868860+0000","last_clean":"2024-04-15T23:31:32.868860+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:32.868860+0000","last_undegraded":"2024-04-15T23:31:32.868860+0000","last_fullsized":"2024-04-15T23:31:32.868860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873528+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:32.873528+0000","last_peered":"2024-04-15T23:31:32.873528+0000","last_clean":"2024-04-15T23:31:32.873528+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:32.873528+0000","last_undegraded":"2024-04-15T23:31:32.873528+0000","last_fullsized":"2024-04-15T23:31:32.873528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873011+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:32.873011+0000","last_peered":"2024-04-15T23:31:32.873011+0000","last_clean":"2024-04-15T23:31:32.873011+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:32.873011+0000","last_undegraded":"2024-04-15T23:31:32.873011+0000","last_fullsized":"2024-04-15T23:31:32.873011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868778+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:32.868778+0000","last_peered":"2024-04-15T23:31:32.868778+0000","last_clean":"2024-04-15T23:31:32.868778+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:32.868778+0000","last_undegraded":"2024-04-15T23:31:32.868778+0000","last_fullsized":"2024-04-15T23:31:32.868778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882190+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:31.882190+0000","last_peered":"2024-04-15T23:31:31.882190+0000","last_clean":"2024-04-15T23:31:31.882190+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:31.882190+0000","last_undegraded":"2024-04-15T23:31:31.882190+0000","last_fullsized":"2024-04-15T23:31:31.882190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868848+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:32.868848+0000","last_peered":"2024-04-15T23:31:32.868848+0000","last_clean":"2024-04-15T23:31:32.868848+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:32.868848+0000","last_undegraded":"2024-04-15T23:31:32.868848+0000","last_fullsized":"2024-04-15T23:31:32.868848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881242+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:31.881242+0000","last_peered":"2024-04-15T23:31:31.881242+0000","last_clean":"2024-04-15T23:31:31.881242+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:31.881242+0000","last_undegraded":"2024-04-15T23:31:31.881242+0000","last_fullsized":"2024-04-15T23:31:31.881242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869567+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:32.869567+0000","last_peered":"2024-04-15T23:31:32.869567+0000","last_clean":"2024-04-15T23:31:32.869567+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:32.869567+0000","last_undegraded":"2024-04-15T23:31:32.869567+0000","last_fullsized":"2024-04-15T23:31:32.869567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873279+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:32.873279+0000","last_peered":"2024-04-15T23:31:32.873279+0000","last_clean":"2024-04-15T23:31:32.873279+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:32.873279+0000","last_undegraded":"2024-04-15T23:31:32.873279+0000","last_fullsized":"2024-04-15T23:31:32.873279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873547+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:32.873547+0000","last_peered":"2024-04-15T23:31:32.873547+0000","last_clean":"2024-04-15T23:31:32.873547+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:32.873547+0000","last_undegraded":"2024-04-15T23:31:32.873547+0000","last_fullsized":"2024-04-15T23:31:32.873547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869117+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:32.869117+0000","last_peered":"2024-04-15T23:31:32.869117+0000","last_clean":"2024-04-15T23:31:32.869117+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:32.869117+0000","last_undegraded":"2024-04-15T23:31:32.869117+0000","last_fullsized":"2024-04-15T23:31:32.869117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873596+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:32.873596+0000","last_peered":"2024-04-15T23:31:32.873596+0000","last_clean":"2024-04-15T23:31:32.873596+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:32.873596+0000","last_undegraded":"2024-04-15T23:31:32.873596+0000","last_fullsized":"2024-04-15T23:31:32.873596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869211+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:32.869211+0000","last_peered":"2024-04-15T23:31:32.869211+0000","last_clean":"2024-04-15T23:31:32.869211+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:32.869211+0000","last_undegraded":"2024-04-15T23:31:32.869211+0000","last_fullsized":"2024-04-15T23:31:32.869211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881418+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:31.881418+0000","last_peered":"2024-04-15T23:31:31.881418+0000","last_clean":"2024-04-15T23:31:31.881418+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:31.881418+0000","last_undegraded":"2024-04-15T23:31:31.881418+0000","last_fullsized":"2024-04-15T23:31:31.881418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869239+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:32.869239+0000","last_peered":"2024-04-15T23:31:32.869239+0000","last_clean":"2024-04-15T23:31:32.869239+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:32.869239+0000","last_undegraded":"2024-04-15T23:31:32.869239+0000","last_fullsized":"2024-04-15T23:31:32.869239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882374+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:31.882374+0000","last_peered":"2024-04-15T23:31:31.882374+0000","last_clean":"2024-04-15T23:31:31.882374+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:31.882374+0000","last_undegraded":"2024-04-15T23:31:31.882374+0000","last_fullsized":"2024-04-15T23:31:31.882374+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881543+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:31.881543+0000","last_peered":"2024-04-15T23:31:31.881543+0000","last_clean":"2024-04-15T23:31:31.881543+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:31.881543+0000","last_undegraded":"2024-04-15T23:31:31.881543+0000","last_fullsized":"2024-04-15T23:31:31.881543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869884+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:32.869884+0000","last_peered":"2024-04-15T23:31:32.869884+0000","last_clean":"2024-04-15T23:31:32.869884+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:32.869884+0000","last_undegraded":"2024-04-15T23:31:32.869884+0000","last_fullsized":"2024-04-15T23:31:32.869884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869595+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:32.869595+0000","last_peered":"2024-04-15T23:31:32.869595+0000","last_clean":"2024-04-15T23:31:32.869595+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:32.869595+0000","last_undegraded":"2024-04-15T23:31:32.869595+0000","last_fullsized":"2024-04-15T23:31:32.869595+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868519+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:32.868519+0000","last_peered":"2024-04-15T23:31:32.868519+0000","last_clean":"2024-04-15T23:31:32.868519+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:32.868519+0000","last_undegraded":"2024-04-15T23:31:32.868519+0000","last_fullsized":"2024-04-15T23:31:32.868519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.871245+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:32.871245+0000","last_peered":"2024-04-15T23:31:32.871245+0000","last_clean":"2024-04-15T23:31:32.871245+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:32.871245+0000","last_undegraded":"2024-04-15T23:31:32.871245+0000","last_fullsized":"2024-04-15T23:31:32.871245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873285+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:32.873285+0000","last_peered":"2024-04-15T23:31:32.873285+0000","last_clean":"2024-04-15T23:31:32.873285+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:32.873285+0000","last_undegraded":"2024-04-15T23:31:32.873285+0000","last_fullsized":"2024-04-15T23:31:32.873285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881196+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:31.881196+0000","last_peered":"2024-04-15T23:31:31.881196+0000","last_clean":"2024-04-15T23:31:31.881196+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:31.881196+0000","last_undegraded":"2024-04-15T23:31:31.881196+0000","last_fullsized":"2024-04-15T23:31:31.881196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873078+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:32.873078+0000","last_peered":"2024-04-15T23:31:32.873078+0000","last_clean":"2024-04-15T23:31:32.873078+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:32.873078+0000","last_undegraded":"2024-04-15T23:31:32.873078+0000","last_fullsized":"2024-04-15T23:31:32.873078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873349+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:32.873349+0000","last_peered":"2024-04-15T23:31:32.873349+0000","last_clean":"2024-04-15T23:31:32.873349+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:32.873349+0000","last_undegraded":"2024-04-15T23:31:32.873349+0000","last_fullsized":"2024-04-15T23:31:32.873349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868520+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:32.868520+0000","last_peered":"2024-04-15T23:31:32.868520+0000","last_clean":"2024-04-15T23:31:32.868520+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:32.868520+0000","last_undegraded":"2024-04-15T23:31:32.868520+0000","last_fullsized":"2024-04-15T23:31:32.868520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882316+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:31.882316+0000","last_peered":"2024-04-15T23:31:31.882316+0000","last_clean":"2024-04-15T23:31:31.882316+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:31.882316+0000","last_undegraded":"2024-04-15T23:31:31.882316+0000","last_fullsized":"2024-04-15T23:31:31.882316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873151+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:32.873151+0000","last_peered":"2024-04-15T23:31:32.873151+0000","last_clean":"2024-04-15T23:31:32.873151+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:32.873151+0000","last_undegraded":"2024-04-15T23:31:32.873151+0000","last_fullsized":"2024-04-15T23:31:32.873151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868637+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:32.868637+0000","last_peered":"2024-04-15T23:31:32.868637+0000","last_clean":"2024-04-15T23:31:32.868637+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:32.868637+0000","last_undegraded":"2024-04-15T23:31:32.868637+0000","last_fullsized":"2024-04-15T23:31:32.868637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869780+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:32.869780+0000","last_peered":"2024-04-15T23:31:32.869780+0000","last_clean":"2024-04-15T23:31:32.869780+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:32.869780+0000","last_undegraded":"2024-04-15T23:31:32.869780+0000","last_fullsized":"2024-04-15T23:31:32.869780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868441+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:32.868441+0000","last_peered":"2024-04-15T23:31:32.868441+0000","last_clean":"2024-04-15T23:31:32.868441+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:32.868441+0000","last_undegraded":"2024-04-15T23:31:32.868441+0000","last_fullsized":"2024-04-15T23:31:32.868441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882405+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:31.882405+0000","last_peered":"2024-04-15T23:31:31.882405+0000","last_clean":"2024-04-15T23:31:31.882405+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:31.882405+0000","last_undegraded":"2024-04-15T23:31:31.882405+0000","last_fullsized":"2024-04-15T23:31:31.882405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868560+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:32.868560+0000","last_peered":"2024-04-15T23:31:32.868560+0000","last_clean":"2024-04-15T23:31:32.868560+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:32.868560+0000","last_undegraded":"2024-04-15T23:31:32.868560+0000","last_fullsized":"2024-04-15T23:31:32.868560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869302+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:32.869302+0000","last_peered":"2024-04-15T23:31:32.869302+0000","last_clean":"2024-04-15T23:31:32.869302+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:32.869302+0000","last_undegraded":"2024-04-15T23:31:32.869302+0000","last_fullsized":"2024-04-15T23:31:32.869302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868627+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:32.868627+0000","last_peered":"2024-04-15T23:31:32.868627+0000","last_clean":"2024-04-15T23:31:32.868627+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:32.868627+0000","last_undegraded":"2024-04-15T23:31:32.868627+0000","last_fullsized":"2024-04-15T23:31:32.868627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882022+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:31.882022+0000","last_peered":"2024-04-15T23:31:31.882022+0000","last_clean":"2024-04-15T23:31:31.882022+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:31.882022+0000","last_undegraded":"2024-04-15T23:31:31.882022+0000","last_fullsized":"2024-04-15T23:31:31.882022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881588+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:31.881588+0000","last_peered":"2024-04-15T23:31:31.881588+0000","last_clean":"2024-04-15T23:31:31.881588+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:31.881588+0000","last_undegraded":"2024-04-15T23:31:31.881588+0000","last_fullsized":"2024-04-15T23:31:31.881588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881564+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:31.881564+0000","last_peered":"2024-04-15T23:31:31.881564+0000","last_clean":"2024-04-15T23:31:31.881564+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:31.881564+0000","last_undegraded":"2024-04-15T23:31:31.881564+0000","last_fullsized":"2024-04-15T23:31:31.881564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881687+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:31.881687+0000","last_peered":"2024-04-15T23:31:31.881687+0000","last_clean":"2024-04-15T23:31:31.881687+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:31.881687+0000","last_undegraded":"2024-04-15T23:31:31.881687+0000","last_fullsized":"2024-04-15T23:31:31.881687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873275+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:32.873275+0000","last_peered":"2024-04-15T23:31:32.873275+0000","last_clean":"2024-04-15T23:31:32.873275+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:32.873275+0000","last_undegraded":"2024-04-15T23:31:32.873275+0000","last_fullsized":"2024-04-15T23:31:32.873275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873266+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:32.873266+0000","last_peered":"2024-04-15T23:31:32.873266+0000","last_clean":"2024-04-15T23:31:32.873266+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:32.873266+0000","last_undegraded":"2024-04-15T23:31:32.873266+0000","last_fullsized":"2024-04-15T23:31:32.873266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873207+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:32.873207+0000","last_peered":"2024-04-15T23:31:32.873207+0000","last_clean":"2024-04-15T23:31:32.873207+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:32.873207+0000","last_undegraded":"2024-04-15T23:31:32.873207+0000","last_fullsized":"2024-04-15T23:31:32.873207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882153+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:31.882153+0000","last_peered":"2024-04-15T23:31:31.882153+0000","last_clean":"2024-04-15T23:31:31.882153+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:31.882153+0000","last_undegraded":"2024-04-15T23:31:31.882153+0000","last_fullsized":"2024-04-15T23:31:31.882153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881611+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:31.881611+0000","last_peered":"2024-04-15T23:31:31.881611+0000","last_clean":"2024-04-15T23:31:31.881611+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:31.881611+0000","last_undegraded":"2024-04-15T23:31:31.881611+0000","last_fullsized":"2024-04-15T23:31:31.881611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869520+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:32.869520+0000","last_peered":"2024-04-15T23:31:32.869520+0000","last_clean":"2024-04-15T23:31:32.869520+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:32.869520+0000","last_undegraded":"2024-04-15T23:31:32.869520+0000","last_fullsized":"2024-04-15T23:31:32.869520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873123+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:32.873123+0000","last_peered":"2024-04-15T23:31:32.873123+0000","last_clean":"2024-04-15T23:31:32.873123+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:32.873123+0000","last_undegraded":"2024-04-15T23:31:32.873123+0000","last_fullsized":"2024-04-15T23:31:32.873123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869698+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:32.869698+0000","last_peered":"2024-04-15T23:31:32.869698+0000","last_clean":"2024-04-15T23:31:32.869698+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:32.869698+0000","last_undegraded":"2024-04-15T23:31:32.869698+0000","last_fullsized":"2024-04-15T23:31:32.869698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:38.515 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-15T23:31:38.516 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-15T23:31:38.516 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-15T23:31:38.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-15T23:31:38.517 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-15T23:31:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:38.901 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3560766687},{"type":"v1","addr":"172.21.15.102:6801","nonce":3560766687}]},"active_addr":"172.21.15.102:6801/3560766687","active_change":"2024-04-15T23:31:19.761204+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":460955300}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2055089589}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1516242244}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2518436849}]}]} 2024-04-15T23:31:38.905 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-15T23:31:38.905 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-15T23:31:38.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:39.189 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:39.189 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:31.867515+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:39.202 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-15T23:31:39.202 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:39.489 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:39.489 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:31.867515+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:39.502 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-15T23:31:39.502 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-15T23:31:39.502 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-15T23:31:39.647 INFO:teuthology.orchestra.run.smithi102.stdout:34359738375 2024-04-15T23:31:39.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T23:31:39.652 INFO:teuthology.orchestra.run.smithi102.stdout:34359738373 2024-04-15T23:31:39.652 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T23:31:39.653 INFO:teuthology.orchestra.run.smithi102.stdout:34359738375 2024-04-15T23:31:39.653 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T23:31:39.964 INFO:teuthology.orchestra.run.smithi102.stdout:34359738375 2024-04-15T23:31:39.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-04-15T23:31:39.978 DEBUG:teuthology.parallel:result is None 2024-04-15T23:31:40.002 INFO:teuthology.orchestra.run.smithi102.stdout:34359738373 2024-04-15T23:31:40.006 INFO:teuthology.orchestra.run.smithi102.stdout:34359738375 2024-04-15T23:31:40.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.0 2024-04-15T23:31:40.015 DEBUG:teuthology.parallel:result is None 2024-04-15T23:31:40.019 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2024-04-15T23:31:40.020 DEBUG:teuthology.parallel:result is None 2024-04-15T23:31:40.020 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T23:31:40.020 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:40.350 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:40.352 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:40.361 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-15T23:31:39.769882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.905612"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882232+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:31.882232+0000","last_peered":"2024-04-15T23:31:31.882232+0000","last_clean":"2024-04-15T23:31:31.882232+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:31.882232+0000","last_undegraded":"2024-04-15T23:31:31.882232+0000","last_fullsized":"2024-04-15T23:31:31.882232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881959+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:31.881959+0000","last_peered":"2024-04-15T23:31:31.881959+0000","last_clean":"2024-04-15T23:31:31.881959+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:31.881959+0000","last_undegraded":"2024-04-15T23:31:31.881959+0000","last_fullsized":"2024-04-15T23:31:31.881959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873116+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:32.873116+0000","last_peered":"2024-04-15T23:31:32.873116+0000","last_clean":"2024-04-15T23:31:32.873116+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:32.873116+0000","last_undegraded":"2024-04-15T23:31:32.873116+0000","last_fullsized":"2024-04-15T23:31:32.873116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872895+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:32.872895+0000","last_peered":"2024-04-15T23:31:32.872895+0000","last_clean":"2024-04-15T23:31:32.872895+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:32.872895+0000","last_undegraded":"2024-04-15T23:31:32.872895+0000","last_fullsized":"2024-04-15T23:31:32.872895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881576+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:31.881576+0000","last_peered":"2024-04-15T23:31:31.881576+0000","last_clean":"2024-04-15T23:31:31.881576+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:31.881576+0000","last_undegraded":"2024-04-15T23:31:31.881576+0000","last_fullsized":"2024-04-15T23:31:31.881576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872413+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:32.872413+0000","last_peered":"2024-04-15T23:31:32.872413+0000","last_clean":"2024-04-15T23:31:32.872413+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:32.872413+0000","last_undegraded":"2024-04-15T23:31:32.872413+0000","last_fullsized":"2024-04-15T23:31:32.872413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872547+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:32.872547+0000","last_peered":"2024-04-15T23:31:32.872547+0000","last_clean":"2024-04-15T23:31:32.872547+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:32.872547+0000","last_undegraded":"2024-04-15T23:31:32.872547+0000","last_fullsized":"2024-04-15T23:31:32.872547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872247+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:32.872247+0000","last_peered":"2024-04-15T23:31:32.872247+0000","last_clean":"2024-04-15T23:31:32.872247+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:32.872247+0000","last_undegraded":"2024-04-15T23:31:32.872247+0000","last_fullsized":"2024-04-15T23:31:32.872247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869374+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:32.869374+0000","last_peered":"2024-04-15T23:31:32.869374+0000","last_clean":"2024-04-15T23:31:32.869374+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:32.869374+0000","last_undegraded":"2024-04-15T23:31:32.869374+0000","last_fullsized":"2024-04-15T23:31:32.869374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881987+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:31.881987+0000","last_peered":"2024-04-15T23:31:31.881987+0000","last_clean":"2024-04-15T23:31:31.881987+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:31.881987+0000","last_undegraded":"2024-04-15T23:31:31.881987+0000","last_fullsized":"2024-04-15T23:31:31.881987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873095+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:32.873095+0000","last_peered":"2024-04-15T23:31:32.873095+0000","last_clean":"2024-04-15T23:31:32.873095+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:32.873095+0000","last_undegraded":"2024-04-15T23:31:32.873095+0000","last_fullsized":"2024-04-15T23:31:32.873095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881697+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:31.881697+0000","last_peered":"2024-04-15T23:31:31.881697+0000","last_clean":"2024-04-15T23:31:31.881697+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:31.881697+0000","last_undegraded":"2024-04-15T23:31:31.881697+0000","last_fullsized":"2024-04-15T23:31:31.881697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881360+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:31.881360+0000","last_peered":"2024-04-15T23:31:31.881360+0000","last_clean":"2024-04-15T23:31:31.881360+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:31.881360+0000","last_undegraded":"2024-04-15T23:31:31.881360+0000","last_fullsized":"2024-04-15T23:31:31.881360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872570+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:32.872570+0000","last_peered":"2024-04-15T23:31:32.872570+0000","last_clean":"2024-04-15T23:31:32.872570+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:32.872570+0000","last_undegraded":"2024-04-15T23:31:32.872570+0000","last_fullsized":"2024-04-15T23:31:32.872570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872656+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:32.872656+0000","last_peered":"2024-04-15T23:31:32.872656+0000","last_clean":"2024-04-15T23:31:32.872656+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:32.872656+0000","last_undegraded":"2024-04-15T23:31:32.872656+0000","last_fullsized":"2024-04-15T23:31:32.872656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872467+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:32.872467+0000","last_peered":"2024-04-15T23:31:32.872467+0000","last_clean":"2024-04-15T23:31:32.872467+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:32.872467+0000","last_undegraded":"2024-04-15T23:31:32.872467+0000","last_fullsized":"2024-04-15T23:31:32.872467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869858+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:32.869858+0000","last_peered":"2024-04-15T23:31:32.869858+0000","last_clean":"2024-04-15T23:31:32.869858+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:32.869858+0000","last_undegraded":"2024-04-15T23:31:32.869858+0000","last_fullsized":"2024-04-15T23:31:32.869858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882220+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:31.882220+0000","last_peered":"2024-04-15T23:31:31.882220+0000","last_clean":"2024-04-15T23:31:31.882220+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:31.882220+0000","last_undegraded":"2024-04-15T23:31:31.882220+0000","last_fullsized":"2024-04-15T23:31:31.882220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869019+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:32.869019+0000","last_peered":"2024-04-15T23:31:32.869019+0000","last_clean":"2024-04-15T23:31:32.869019+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:32.869019+0000","last_undegraded":"2024-04-15T23:31:32.869019+0000","last_fullsized":"2024-04-15T23:31:32.869019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873131+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:32.873131+0000","last_peered":"2024-04-15T23:31:32.873131+0000","last_clean":"2024-04-15T23:31:32.873131+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:32.873131+0000","last_undegraded":"2024-04-15T23:31:32.873131+0000","last_fullsized":"2024-04-15T23:31:32.873131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873464+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:32.873464+0000","last_peered":"2024-04-15T23:31:32.873464+0000","last_clean":"2024-04-15T23:31:32.873464+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:32.873464+0000","last_undegraded":"2024-04-15T23:31:32.873464+0000","last_fullsized":"2024-04-15T23:31:32.873464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881386+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:31.881386+0000","last_peered":"2024-04-15T23:31:31.881386+0000","last_clean":"2024-04-15T23:31:31.881386+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:31.881386+0000","last_undegraded":"2024-04-15T23:31:31.881386+0000","last_fullsized":"2024-04-15T23:31:31.881386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868278+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:32.868278+0000","last_peered":"2024-04-15T23:31:32.868278+0000","last_clean":"2024-04-15T23:31:32.868278+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:32.868278+0000","last_undegraded":"2024-04-15T23:31:32.868278+0000","last_fullsized":"2024-04-15T23:31:32.868278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.880945+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:31.880945+0000","last_peered":"2024-04-15T23:31:31.880945+0000","last_clean":"2024-04-15T23:31:31.880945+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:31.880945+0000","last_undegraded":"2024-04-15T23:31:31.880945+0000","last_fullsized":"2024-04-15T23:31:31.880945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882304+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:31.882304+0000","last_peered":"2024-04-15T23:31:31.882304+0000","last_clean":"2024-04-15T23:31:31.882304+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:31.882304+0000","last_undegraded":"2024-04-15T23:31:31.882304+0000","last_fullsized":"2024-04-15T23:31:31.882304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869414+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869414+0000","last_peered":"2024-04-15T23:31:32.869414+0000","last_clean":"2024-04-15T23:31:32.869414+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:32.869414+0000","last_undegraded":"2024-04-15T23:31:32.869414+0000","last_fullsized":"2024-04-15T23:31:32.869414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873492+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:32.873492+0000","last_peered":"2024-04-15T23:31:32.873492+0000","last_clean":"2024-04-15T23:31:32.873492+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:32.873492+0000","last_undegraded":"2024-04-15T23:31:32.873492+0000","last_fullsized":"2024-04-15T23:31:32.873492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881984+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:31.881984+0000","last_peered":"2024-04-15T23:31:31.881984+0000","last_clean":"2024-04-15T23:31:31.881984+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:31.881984+0000","last_undegraded":"2024-04-15T23:31:31.881984+0000","last_fullsized":"2024-04-15T23:31:31.881984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869197+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:32.869197+0000","last_peered":"2024-04-15T23:31:32.869197+0000","last_clean":"2024-04-15T23:31:32.869197+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:32.869197+0000","last_undegraded":"2024-04-15T23:31:32.869197+0000","last_fullsized":"2024-04-15T23:31:32.869197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881682+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:31.881682+0000","last_peered":"2024-04-15T23:31:31.881682+0000","last_clean":"2024-04-15T23:31:31.881682+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:31.881682+0000","last_undegraded":"2024-04-15T23:31:31.881682+0000","last_fullsized":"2024-04-15T23:31:31.881682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868338+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:32.868338+0000","last_peered":"2024-04-15T23:31:32.868338+0000","last_clean":"2024-04-15T23:31:32.868338+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:32.868338+0000","last_undegraded":"2024-04-15T23:31:32.868338+0000","last_fullsized":"2024-04-15T23:31:32.868338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872437+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:32.872437+0000","last_peered":"2024-04-15T23:31:32.872437+0000","last_clean":"2024-04-15T23:31:32.872437+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:32.872437+0000","last_undegraded":"2024-04-15T23:31:32.872437+0000","last_fullsized":"2024-04-15T23:31:32.872437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881756+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:31.881756+0000","last_peered":"2024-04-15T23:31:31.881756+0000","last_clean":"2024-04-15T23:31:31.881756+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:31.881756+0000","last_undegraded":"2024-04-15T23:31:31.881756+0000","last_fullsized":"2024-04-15T23:31:31.881756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873498+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:32.873498+0000","last_peered":"2024-04-15T23:31:32.873498+0000","last_clean":"2024-04-15T23:31:32.873498+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:32.873498+0000","last_undegraded":"2024-04-15T23:31:32.873498+0000","last_fullsized":"2024-04-15T23:31:32.873498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882157+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:31.882157+0000","last_peered":"2024-04-15T23:31:31.882157+0000","last_clean":"2024-04-15T23:31:31.882157+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:31.882157+0000","last_undegraded":"2024-04-15T23:31:31.882157+0000","last_fullsized":"2024-04-15T23:31:31.882157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868654+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:32.868654+0000","last_peered":"2024-04-15T23:31:32.868654+0000","last_clean":"2024-04-15T23:31:32.868654+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:32.868654+0000","last_undegraded":"2024-04-15T23:31:32.868654+0000","last_fullsized":"2024-04-15T23:31:32.868654+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869537+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869537+0000","last_peered":"2024-04-15T23:31:32.869537+0000","last_clean":"2024-04-15T23:31:32.869537+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:32.869537+0000","last_undegraded":"2024-04-15T23:31:32.869537+0000","last_fullsized":"2024-04-15T23:31:32.869537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881346+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:31.881346+0000","last_peered":"2024-04-15T23:31:31.881346+0000","last_clean":"2024-04-15T23:31:31.881346+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:31.881346+0000","last_undegraded":"2024-04-15T23:31:31.881346+0000","last_fullsized":"2024-04-15T23:31:31.881346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869351+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:32.869351+0000","last_peered":"2024-04-15T23:31:32.869351+0000","last_clean":"2024-04-15T23:31:32.869351+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:32.869351+0000","last_undegraded":"2024-04-15T23:31:32.869351+0000","last_fullsized":"2024-04-15T23:31:32.869351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872629+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:32.872629+0000","last_peered":"2024-04-15T23:31:32.872629+0000","last_clean":"2024-04-15T23:31:32.872629+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:32.872629+0000","last_undegraded":"2024-04-15T23:31:32.872629+0000","last_fullsized":"2024-04-15T23:31:32.872629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873206+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:32.873206+0000","last_peered":"2024-04-15T23:31:32.873206+0000","last_clean":"2024-04-15T23:31:32.873206+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:32.873206+0000","last_undegraded":"2024-04-15T23:31:32.873206+0000","last_fullsized":"2024-04-15T23:31:32.873206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881005+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:31.881005+0000","last_peered":"2024-04-15T23:31:31.881005+0000","last_clean":"2024-04-15T23:31:31.881005+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:31.881005+0000","last_undegraded":"2024-04-15T23:31:31.881005+0000","last_fullsized":"2024-04-15T23:31:31.881005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882332+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:31.882332+0000","last_peered":"2024-04-15T23:31:31.882332+0000","last_clean":"2024-04-15T23:31:31.882332+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:31.882332+0000","last_undegraded":"2024-04-15T23:31:31.882332+0000","last_fullsized":"2024-04-15T23:31:31.882332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881199+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:31.881199+0000","last_peered":"2024-04-15T23:31:31.881199+0000","last_clean":"2024-04-15T23:31:31.881199+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:31.881199+0000","last_undegraded":"2024-04-15T23:31:31.881199+0000","last_fullsized":"2024-04-15T23:31:31.881199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873620+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:32.873620+0000","last_peered":"2024-04-15T23:31:32.873620+0000","last_clean":"2024-04-15T23:31:32.873620+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:32.873620+0000","last_undegraded":"2024-04-15T23:31:32.873620+0000","last_fullsized":"2024-04-15T23:31:32.873620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872743+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:32.872743+0000","last_peered":"2024-04-15T23:31:32.872743+0000","last_clean":"2024-04-15T23:31:32.872743+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:32.872743+0000","last_undegraded":"2024-04-15T23:31:32.872743+0000","last_fullsized":"2024-04-15T23:31:32.872743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873389+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:32.873389+0000","last_peered":"2024-04-15T23:31:32.873389+0000","last_clean":"2024-04-15T23:31:32.873389+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:32.873389+0000","last_undegraded":"2024-04-15T23:31:32.873389+0000","last_fullsized":"2024-04-15T23:31:32.873389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868888+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:32.868888+0000","last_peered":"2024-04-15T23:31:32.868888+0000","last_clean":"2024-04-15T23:31:32.868888+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:32.868888+0000","last_undegraded":"2024-04-15T23:31:32.868888+0000","last_fullsized":"2024-04-15T23:31:32.868888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869420+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:32.869420+0000","last_peered":"2024-04-15T23:31:32.869420+0000","last_clean":"2024-04-15T23:31:32.869420+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:32.869420+0000","last_undegraded":"2024-04-15T23:31:32.869420+0000","last_fullsized":"2024-04-15T23:31:32.869420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873238+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:32.873238+0000","last_peered":"2024-04-15T23:31:32.873238+0000","last_clean":"2024-04-15T23:31:32.873238+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:32.873238+0000","last_undegraded":"2024-04-15T23:31:32.873238+0000","last_fullsized":"2024-04-15T23:31:32.873238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873205+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:32.873205+0000","last_peered":"2024-04-15T23:31:32.873205+0000","last_clean":"2024-04-15T23:31:32.873205+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:32.873205+0000","last_undegraded":"2024-04-15T23:31:32.873205+0000","last_fullsized":"2024-04-15T23:31:32.873205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873417+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:32.873417+0000","last_peered":"2024-04-15T23:31:32.873417+0000","last_clean":"2024-04-15T23:31:32.873417+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:32.873417+0000","last_undegraded":"2024-04-15T23:31:32.873417+0000","last_fullsized":"2024-04-15T23:31:32.873417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881379+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:31.881379+0000","last_peered":"2024-04-15T23:31:31.881379+0000","last_clean":"2024-04-15T23:31:31.881379+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:31.881379+0000","last_undegraded":"2024-04-15T23:31:31.881379+0000","last_fullsized":"2024-04-15T23:31:31.881379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873159+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:32.873159+0000","last_peered":"2024-04-15T23:31:32.873159+0000","last_clean":"2024-04-15T23:31:32.873159+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:32.873159+0000","last_undegraded":"2024-04-15T23:31:32.873159+0000","last_fullsized":"2024-04-15T23:31:32.873159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881106+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:31.881106+0000","last_peered":"2024-04-15T23:31:31.881106+0000","last_clean":"2024-04-15T23:31:31.881106+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:31.881106+0000","last_undegraded":"2024-04-15T23:31:31.881106+0000","last_fullsized":"2024-04-15T23:31:31.881106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869573+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:32.869573+0000","last_peered":"2024-04-15T23:31:32.869573+0000","last_clean":"2024-04-15T23:31:32.869573+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:32.869573+0000","last_undegraded":"2024-04-15T23:31:32.869573+0000","last_fullsized":"2024-04-15T23:31:32.869573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873127+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:32.873127+0000","last_peered":"2024-04-15T23:31:32.873127+0000","last_clean":"2024-04-15T23:31:32.873127+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:32.873127+0000","last_undegraded":"2024-04-15T23:31:32.873127+0000","last_fullsized":"2024-04-15T23:31:32.873127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873569+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:32.873569+0000","last_peered":"2024-04-15T23:31:32.873569+0000","last_clean":"2024-04-15T23:31:32.873569+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:32.873569+0000","last_undegraded":"2024-04-15T23:31:32.873569+0000","last_fullsized":"2024-04-15T23:31:32.873569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868860+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:32.868860+0000","last_peered":"2024-04-15T23:31:32.868860+0000","last_clean":"2024-04-15T23:31:32.868860+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:32.868860+0000","last_undegraded":"2024-04-15T23:31:32.868860+0000","last_fullsized":"2024-04-15T23:31:32.868860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873528+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:32.873528+0000","last_peered":"2024-04-15T23:31:32.873528+0000","last_clean":"2024-04-15T23:31:32.873528+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:32.873528+0000","last_undegraded":"2024-04-15T23:31:32.873528+0000","last_fullsized":"2024-04-15T23:31:32.873528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873011+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:32.873011+0000","last_peered":"2024-04-15T23:31:32.873011+0000","last_clean":"2024-04-15T23:31:32.873011+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:32.873011+0000","last_undegraded":"2024-04-15T23:31:32.873011+0000","last_fullsized":"2024-04-15T23:31:32.873011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868778+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:32.868778+0000","last_peered":"2024-04-15T23:31:32.868778+0000","last_clean":"2024-04-15T23:31:32.868778+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:32.868778+0000","last_undegraded":"2024-04-15T23:31:32.868778+0000","last_fullsized":"2024-04-15T23:31:32.868778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882190+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:31.882190+0000","last_peered":"2024-04-15T23:31:31.882190+0000","last_clean":"2024-04-15T23:31:31.882190+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:31.882190+0000","last_undegraded":"2024-04-15T23:31:31.882190+0000","last_fullsized":"2024-04-15T23:31:31.882190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868848+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:32.868848+0000","last_peered":"2024-04-15T23:31:32.868848+0000","last_clean":"2024-04-15T23:31:32.868848+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:32.868848+0000","last_undegraded":"2024-04-15T23:31:32.868848+0000","last_fullsized":"2024-04-15T23:31:32.868848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881242+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:31.881242+0000","last_peered":"2024-04-15T23:31:31.881242+0000","last_clean":"2024-04-15T23:31:31.881242+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:31.881242+0000","last_undegraded":"2024-04-15T23:31:31.881242+0000","last_fullsized":"2024-04-15T23:31:31.881242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869567+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:32.869567+0000","last_peered":"2024-04-15T23:31:32.869567+0000","last_clean":"2024-04-15T23:31:32.869567+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:32.869567+0000","last_undegraded":"2024-04-15T23:31:32.869567+0000","last_fullsized":"2024-04-15T23:31:32.869567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873279+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:32.873279+0000","last_peered":"2024-04-15T23:31:32.873279+0000","last_clean":"2024-04-15T23:31:32.873279+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:32.873279+0000","last_undegraded":"2024-04-15T23:31:32.873279+0000","last_fullsized":"2024-04-15T23:31:32.873279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873547+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:32.873547+0000","last_peered":"2024-04-15T23:31:32.873547+0000","last_clean":"2024-04-15T23:31:32.873547+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:32.873547+0000","last_undegraded":"2024-04-15T23:31:32.873547+0000","last_fullsized":"2024-04-15T23:31:32.873547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869117+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:32.869117+0000","last_peered":"2024-04-15T23:31:32.869117+0000","last_clean":"2024-04-15T23:31:32.869117+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:32.869117+0000","last_undegraded":"2024-04-15T23:31:32.869117+0000","last_fullsized":"2024-04-15T23:31:32.869117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873596+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:32.873596+0000","last_peered":"2024-04-15T23:31:32.873596+0000","last_clean":"2024-04-15T23:31:32.873596+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:32.873596+0000","last_undegraded":"2024-04-15T23:31:32.873596+0000","last_fullsized":"2024-04-15T23:31:32.873596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869211+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:32.869211+0000","last_peered":"2024-04-15T23:31:32.869211+0000","last_clean":"2024-04-15T23:31:32.869211+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:32.869211+0000","last_undegraded":"2024-04-15T23:31:32.869211+0000","last_fullsized":"2024-04-15T23:31:32.869211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881418+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:31.881418+0000","last_peered":"2024-04-15T23:31:31.881418+0000","last_clean":"2024-04-15T23:31:31.881418+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:31.881418+0000","last_undegraded":"2024-04-15T23:31:31.881418+0000","last_fullsized":"2024-04-15T23:31:31.881418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869239+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:32.869239+0000","last_peered":"2024-04-15T23:31:32.869239+0000","last_clean":"2024-04-15T23:31:32.869239+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:32.869239+0000","last_undegraded":"2024-04-15T23:31:32.869239+0000","last_fullsized":"2024-04-15T23:31:32.869239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882374+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:31.882374+0000","last_peered":"2024-04-15T23:31:31.882374+0000","last_clean":"2024-04-15T23:31:31.882374+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:31.882374+0000","last_undegraded":"2024-04-15T23:31:31.882374+0000","last_fullsized":"2024-04-15T23:31:31.882374+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881543+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:31.881543+0000","last_peered":"2024-04-15T23:31:31.881543+0000","last_clean":"2024-04-15T23:31:31.881543+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:31.881543+0000","last_undegraded":"2024-04-15T23:31:31.881543+0000","last_fullsized":"2024-04-15T23:31:31.881543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869884+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:32.869884+0000","last_peered":"2024-04-15T23:31:32.869884+0000","last_clean":"2024-04-15T23:31:32.869884+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:32.869884+0000","last_undegraded":"2024-04-15T23:31:32.869884+0000","last_fullsized":"2024-04-15T23:31:32.869884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869595+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:32.869595+0000","last_peered":"2024-04-15T23:31:32.869595+0000","last_clean":"2024-04-15T23:31:32.869595+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:32.869595+0000","last_undegraded":"2024-04-15T23:31:32.869595+0000","last_fullsized":"2024-04-15T23:31:32.869595+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868519+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:32.868519+0000","last_peered":"2024-04-15T23:31:32.868519+0000","last_clean":"2024-04-15T23:31:32.868519+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:32.868519+0000","last_undegraded":"2024-04-15T23:31:32.868519+0000","last_fullsized":"2024-04-15T23:31:32.868519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.871245+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:32.871245+0000","last_peered":"2024-04-15T23:31:32.871245+0000","last_clean":"2024-04-15T23:31:32.871245+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:32.871245+0000","last_undegraded":"2024-04-15T23:31:32.871245+0000","last_fullsized":"2024-04-15T23:31:32.871245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873285+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:32.873285+0000","last_peered":"2024-04-15T23:31:32.873285+0000","last_clean":"2024-04-15T23:31:32.873285+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:32.873285+0000","last_undegraded":"2024-04-15T23:31:32.873285+0000","last_fullsized":"2024-04-15T23:31:32.873285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881196+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:31.881196+0000","last_peered":"2024-04-15T23:31:31.881196+0000","last_clean":"2024-04-15T23:31:31.881196+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:31.881196+0000","last_undegraded":"2024-04-15T23:31:31.881196+0000","last_fullsized":"2024-04-15T23:31:31.881196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873078+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:32.873078+0000","last_peered":"2024-04-15T23:31:32.873078+0000","last_clean":"2024-04-15T23:31:32.873078+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:32.873078+0000","last_undegraded":"2024-04-15T23:31:32.873078+0000","last_fullsized":"2024-04-15T23:31:32.873078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873349+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:32.873349+0000","last_peered":"2024-04-15T23:31:32.873349+0000","last_clean":"2024-04-15T23:31:32.873349+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:32.873349+0000","last_undegraded":"2024-04-15T23:31:32.873349+0000","last_fullsized":"2024-04-15T23:31:32.873349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868520+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:32.868520+0000","last_peered":"2024-04-15T23:31:32.868520+0000","last_clean":"2024-04-15T23:31:32.868520+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:32.868520+0000","last_undegraded":"2024-04-15T23:31:32.868520+0000","last_fullsized":"2024-04-15T23:31:32.868520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882316+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:31.882316+0000","last_peered":"2024-04-15T23:31:31.882316+0000","last_clean":"2024-04-15T23:31:31.882316+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:31.882316+0000","last_undegraded":"2024-04-15T23:31:31.882316+0000","last_fullsized":"2024-04-15T23:31:31.882316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873151+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:32.873151+0000","last_peered":"2024-04-15T23:31:32.873151+0000","last_clean":"2024-04-15T23:31:32.873151+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:32.873151+0000","last_undegraded":"2024-04-15T23:31:32.873151+0000","last_fullsized":"2024-04-15T23:31:32.873151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868637+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:32.868637+0000","last_peered":"2024-04-15T23:31:32.868637+0000","last_clean":"2024-04-15T23:31:32.868637+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:32.868637+0000","last_undegraded":"2024-04-15T23:31:32.868637+0000","last_fullsized":"2024-04-15T23:31:32.868637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869780+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:32.869780+0000","last_peered":"2024-04-15T23:31:32.869780+0000","last_clean":"2024-04-15T23:31:32.869780+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:32.869780+0000","last_undegraded":"2024-04-15T23:31:32.869780+0000","last_fullsized":"2024-04-15T23:31:32.869780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868441+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:32.868441+0000","last_peered":"2024-04-15T23:31:32.868441+0000","last_clean":"2024-04-15T23:31:32.868441+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:32.868441+0000","last_undegraded":"2024-04-15T23:31:32.868441+0000","last_fullsized":"2024-04-15T23:31:32.868441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882405+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:31.882405+0000","last_peered":"2024-04-15T23:31:31.882405+0000","last_clean":"2024-04-15T23:31:31.882405+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:31.882405+0000","last_undegraded":"2024-04-15T23:31:31.882405+0000","last_fullsized":"2024-04-15T23:31:31.882405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868560+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:32.868560+0000","last_peered":"2024-04-15T23:31:32.868560+0000","last_clean":"2024-04-15T23:31:32.868560+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:32.868560+0000","last_undegraded":"2024-04-15T23:31:32.868560+0000","last_fullsized":"2024-04-15T23:31:32.868560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869302+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:32.869302+0000","last_peered":"2024-04-15T23:31:32.869302+0000","last_clean":"2024-04-15T23:31:32.869302+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:32.869302+0000","last_undegraded":"2024-04-15T23:31:32.869302+0000","last_fullsized":"2024-04-15T23:31:32.869302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868627+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:32.868627+0000","last_peered":"2024-04-15T23:31:32.868627+0000","last_clean":"2024-04-15T23:31:32.868627+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:32.868627+0000","last_undegraded":"2024-04-15T23:31:32.868627+0000","last_fullsized":"2024-04-15T23:31:32.868627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882022+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:31.882022+0000","last_peered":"2024-04-15T23:31:31.882022+0000","last_clean":"2024-04-15T23:31:31.882022+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:31.882022+0000","last_undegraded":"2024-04-15T23:31:31.882022+0000","last_fullsized":"2024-04-15T23:31:31.882022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881588+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:31.881588+0000","last_peered":"2024-04-15T23:31:31.881588+0000","last_clean":"2024-04-15T23:31:31.881588+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:31.881588+0000","last_undegraded":"2024-04-15T23:31:31.881588+0000","last_fullsized":"2024-04-15T23:31:31.881588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881564+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:31.881564+0000","last_peered":"2024-04-15T23:31:31.881564+0000","last_clean":"2024-04-15T23:31:31.881564+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:31.881564+0000","last_undegraded":"2024-04-15T23:31:31.881564+0000","last_fullsized":"2024-04-15T23:31:31.881564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881687+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:31.881687+0000","last_peered":"2024-04-15T23:31:31.881687+0000","last_clean":"2024-04-15T23:31:31.881687+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:31.881687+0000","last_undegraded":"2024-04-15T23:31:31.881687+0000","last_fullsized":"2024-04-15T23:31:31.881687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873275+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:32.873275+0000","last_peered":"2024-04-15T23:31:32.873275+0000","last_clean":"2024-04-15T23:31:32.873275+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:32.873275+0000","last_undegraded":"2024-04-15T23:31:32.873275+0000","last_fullsized":"2024-04-15T23:31:32.873275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873266+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:32.873266+0000","last_peered":"2024-04-15T23:31:32.873266+0000","last_clean":"2024-04-15T23:31:32.873266+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:32.873266+0000","last_undegraded":"2024-04-15T23:31:32.873266+0000","last_fullsized":"2024-04-15T23:31:32.873266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873207+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:32.873207+0000","last_peered":"2024-04-15T23:31:32.873207+0000","last_clean":"2024-04-15T23:31:32.873207+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:32.873207+0000","last_undegraded":"2024-04-15T23:31:32.873207+0000","last_fullsized":"2024-04-15T23:31:32.873207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882153+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:31.882153+0000","last_peered":"2024-04-15T23:31:31.882153+0000","last_clean":"2024-04-15T23:31:31.882153+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:31.882153+0000","last_undegraded":"2024-04-15T23:31:31.882153+0000","last_fullsized":"2024-04-15T23:31:31.882153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881611+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:31.881611+0000","last_peered":"2024-04-15T23:31:31.881611+0000","last_clean":"2024-04-15T23:31:31.881611+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:31.881611+0000","last_undegraded":"2024-04-15T23:31:31.881611+0000","last_fullsized":"2024-04-15T23:31:31.881611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869520+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:32.869520+0000","last_peered":"2024-04-15T23:31:32.869520+0000","last_clean":"2024-04-15T23:31:32.869520+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:32.869520+0000","last_undegraded":"2024-04-15T23:31:32.869520+0000","last_fullsized":"2024-04-15T23:31:32.869520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873123+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:32.873123+0000","last_peered":"2024-04-15T23:31:32.873123+0000","last_clean":"2024-04-15T23:31:32.873123+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:32.873123+0000","last_undegraded":"2024-04-15T23:31:32.873123+0000","last_fullsized":"2024-04-15T23:31:32.873123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869698+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:32.869698+0000","last_peered":"2024-04-15T23:31:32.869698+0000","last_clean":"2024-04-15T23:31:32.869698+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:32.869698+0000","last_undegraded":"2024-04-15T23:31:32.869698+0000","last_fullsized":"2024-04-15T23:31:32.869698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:40.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:40.690 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:40.692 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:40.702 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-15T23:31:39.769882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.905612"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882232+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:31.882232+0000","last_peered":"2024-04-15T23:31:31.882232+0000","last_clean":"2024-04-15T23:31:31.882232+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:31.882232+0000","last_undegraded":"2024-04-15T23:31:31.882232+0000","last_fullsized":"2024-04-15T23:31:31.882232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881959+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:31.881959+0000","last_peered":"2024-04-15T23:31:31.881959+0000","last_clean":"2024-04-15T23:31:31.881959+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:31.881959+0000","last_undegraded":"2024-04-15T23:31:31.881959+0000","last_fullsized":"2024-04-15T23:31:31.881959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873116+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:32.873116+0000","last_peered":"2024-04-15T23:31:32.873116+0000","last_clean":"2024-04-15T23:31:32.873116+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:32.873116+0000","last_undegraded":"2024-04-15T23:31:32.873116+0000","last_fullsized":"2024-04-15T23:31:32.873116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872895+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:32.872895+0000","last_peered":"2024-04-15T23:31:32.872895+0000","last_clean":"2024-04-15T23:31:32.872895+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:32.872895+0000","last_undegraded":"2024-04-15T23:31:32.872895+0000","last_fullsized":"2024-04-15T23:31:32.872895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881576+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:31.881576+0000","last_peered":"2024-04-15T23:31:31.881576+0000","last_clean":"2024-04-15T23:31:31.881576+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:31.881576+0000","last_undegraded":"2024-04-15T23:31:31.881576+0000","last_fullsized":"2024-04-15T23:31:31.881576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872413+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:32.872413+0000","last_peered":"2024-04-15T23:31:32.872413+0000","last_clean":"2024-04-15T23:31:32.872413+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:32.872413+0000","last_undegraded":"2024-04-15T23:31:32.872413+0000","last_fullsized":"2024-04-15T23:31:32.872413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872547+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:32.872547+0000","last_peered":"2024-04-15T23:31:32.872547+0000","last_clean":"2024-04-15T23:31:32.872547+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:32.872547+0000","last_undegraded":"2024-04-15T23:31:32.872547+0000","last_fullsized":"2024-04-15T23:31:32.872547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872247+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:32.872247+0000","last_peered":"2024-04-15T23:31:32.872247+0000","last_clean":"2024-04-15T23:31:32.872247+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:32.872247+0000","last_undegraded":"2024-04-15T23:31:32.872247+0000","last_fullsized":"2024-04-15T23:31:32.872247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869374+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:32.869374+0000","last_peered":"2024-04-15T23:31:32.869374+0000","last_clean":"2024-04-15T23:31:32.869374+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:32.869374+0000","last_undegraded":"2024-04-15T23:31:32.869374+0000","last_fullsized":"2024-04-15T23:31:32.869374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881987+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:31.881987+0000","last_peered":"2024-04-15T23:31:31.881987+0000","last_clean":"2024-04-15T23:31:31.881987+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:31.881987+0000","last_undegraded":"2024-04-15T23:31:31.881987+0000","last_fullsized":"2024-04-15T23:31:31.881987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873095+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:32.873095+0000","last_peered":"2024-04-15T23:31:32.873095+0000","last_clean":"2024-04-15T23:31:32.873095+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:32.873095+0000","last_undegraded":"2024-04-15T23:31:32.873095+0000","last_fullsized":"2024-04-15T23:31:32.873095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881697+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:31.881697+0000","last_peered":"2024-04-15T23:31:31.881697+0000","last_clean":"2024-04-15T23:31:31.881697+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:31.881697+0000","last_undegraded":"2024-04-15T23:31:31.881697+0000","last_fullsized":"2024-04-15T23:31:31.881697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881360+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:31.881360+0000","last_peered":"2024-04-15T23:31:31.881360+0000","last_clean":"2024-04-15T23:31:31.881360+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:31.881360+0000","last_undegraded":"2024-04-15T23:31:31.881360+0000","last_fullsized":"2024-04-15T23:31:31.881360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872570+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:32.872570+0000","last_peered":"2024-04-15T23:31:32.872570+0000","last_clean":"2024-04-15T23:31:32.872570+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:32.872570+0000","last_undegraded":"2024-04-15T23:31:32.872570+0000","last_fullsized":"2024-04-15T23:31:32.872570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872656+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:32.872656+0000","last_peered":"2024-04-15T23:31:32.872656+0000","last_clean":"2024-04-15T23:31:32.872656+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:32.872656+0000","last_undegraded":"2024-04-15T23:31:32.872656+0000","last_fullsized":"2024-04-15T23:31:32.872656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872467+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:32.872467+0000","last_peered":"2024-04-15T23:31:32.872467+0000","last_clean":"2024-04-15T23:31:32.872467+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:32.872467+0000","last_undegraded":"2024-04-15T23:31:32.872467+0000","last_fullsized":"2024-04-15T23:31:32.872467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869858+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:32.869858+0000","last_peered":"2024-04-15T23:31:32.869858+0000","last_clean":"2024-04-15T23:31:32.869858+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:32.869858+0000","last_undegraded":"2024-04-15T23:31:32.869858+0000","last_fullsized":"2024-04-15T23:31:32.869858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882220+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:31.882220+0000","last_peered":"2024-04-15T23:31:31.882220+0000","last_clean":"2024-04-15T23:31:31.882220+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:31.882220+0000","last_undegraded":"2024-04-15T23:31:31.882220+0000","last_fullsized":"2024-04-15T23:31:31.882220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869019+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:32.869019+0000","last_peered":"2024-04-15T23:31:32.869019+0000","last_clean":"2024-04-15T23:31:32.869019+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:32.869019+0000","last_undegraded":"2024-04-15T23:31:32.869019+0000","last_fullsized":"2024-04-15T23:31:32.869019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873131+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:32.873131+0000","last_peered":"2024-04-15T23:31:32.873131+0000","last_clean":"2024-04-15T23:31:32.873131+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:32.873131+0000","last_undegraded":"2024-04-15T23:31:32.873131+0000","last_fullsized":"2024-04-15T23:31:32.873131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873464+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:32.873464+0000","last_peered":"2024-04-15T23:31:32.873464+0000","last_clean":"2024-04-15T23:31:32.873464+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:32.873464+0000","last_undegraded":"2024-04-15T23:31:32.873464+0000","last_fullsized":"2024-04-15T23:31:32.873464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881386+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:31.881386+0000","last_peered":"2024-04-15T23:31:31.881386+0000","last_clean":"2024-04-15T23:31:31.881386+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:31.881386+0000","last_undegraded":"2024-04-15T23:31:31.881386+0000","last_fullsized":"2024-04-15T23:31:31.881386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868278+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:32.868278+0000","last_peered":"2024-04-15T23:31:32.868278+0000","last_clean":"2024-04-15T23:31:32.868278+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:32.868278+0000","last_undegraded":"2024-04-15T23:31:32.868278+0000","last_fullsized":"2024-04-15T23:31:32.868278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.880945+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:31.880945+0000","last_peered":"2024-04-15T23:31:31.880945+0000","last_clean":"2024-04-15T23:31:31.880945+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:31.880945+0000","last_undegraded":"2024-04-15T23:31:31.880945+0000","last_fullsized":"2024-04-15T23:31:31.880945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882304+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:31.882304+0000","last_peered":"2024-04-15T23:31:31.882304+0000","last_clean":"2024-04-15T23:31:31.882304+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:31.882304+0000","last_undegraded":"2024-04-15T23:31:31.882304+0000","last_fullsized":"2024-04-15T23:31:31.882304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869414+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869414+0000","last_peered":"2024-04-15T23:31:32.869414+0000","last_clean":"2024-04-15T23:31:32.869414+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:32.869414+0000","last_undegraded":"2024-04-15T23:31:32.869414+0000","last_fullsized":"2024-04-15T23:31:32.869414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873492+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:32.873492+0000","last_peered":"2024-04-15T23:31:32.873492+0000","last_clean":"2024-04-15T23:31:32.873492+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:32.873492+0000","last_undegraded":"2024-04-15T23:31:32.873492+0000","last_fullsized":"2024-04-15T23:31:32.873492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881984+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:31.881984+0000","last_peered":"2024-04-15T23:31:31.881984+0000","last_clean":"2024-04-15T23:31:31.881984+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:31.881984+0000","last_undegraded":"2024-04-15T23:31:31.881984+0000","last_fullsized":"2024-04-15T23:31:31.881984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869197+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:32.869197+0000","last_peered":"2024-04-15T23:31:32.869197+0000","last_clean":"2024-04-15T23:31:32.869197+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:32.869197+0000","last_undegraded":"2024-04-15T23:31:32.869197+0000","last_fullsized":"2024-04-15T23:31:32.869197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881682+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:31.881682+0000","last_peered":"2024-04-15T23:31:31.881682+0000","last_clean":"2024-04-15T23:31:31.881682+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:31.881682+0000","last_undegraded":"2024-04-15T23:31:31.881682+0000","last_fullsized":"2024-04-15T23:31:31.881682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868338+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:32.868338+0000","last_peered":"2024-04-15T23:31:32.868338+0000","last_clean":"2024-04-15T23:31:32.868338+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:32.868338+0000","last_undegraded":"2024-04-15T23:31:32.868338+0000","last_fullsized":"2024-04-15T23:31:32.868338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872437+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:32.872437+0000","last_peered":"2024-04-15T23:31:32.872437+0000","last_clean":"2024-04-15T23:31:32.872437+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:32.872437+0000","last_undegraded":"2024-04-15T23:31:32.872437+0000","last_fullsized":"2024-04-15T23:31:32.872437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881756+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:31.881756+0000","last_peered":"2024-04-15T23:31:31.881756+0000","last_clean":"2024-04-15T23:31:31.881756+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:31.881756+0000","last_undegraded":"2024-04-15T23:31:31.881756+0000","last_fullsized":"2024-04-15T23:31:31.881756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873498+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:32.873498+0000","last_peered":"2024-04-15T23:31:32.873498+0000","last_clean":"2024-04-15T23:31:32.873498+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:32.873498+0000","last_undegraded":"2024-04-15T23:31:32.873498+0000","last_fullsized":"2024-04-15T23:31:32.873498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882157+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:31.882157+0000","last_peered":"2024-04-15T23:31:31.882157+0000","last_clean":"2024-04-15T23:31:31.882157+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:31.882157+0000","last_undegraded":"2024-04-15T23:31:31.882157+0000","last_fullsized":"2024-04-15T23:31:31.882157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868654+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:32.868654+0000","last_peered":"2024-04-15T23:31:32.868654+0000","last_clean":"2024-04-15T23:31:32.868654+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:32.868654+0000","last_undegraded":"2024-04-15T23:31:32.868654+0000","last_fullsized":"2024-04-15T23:31:32.868654+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869537+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869537+0000","last_peered":"2024-04-15T23:31:32.869537+0000","last_clean":"2024-04-15T23:31:32.869537+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:32.869537+0000","last_undegraded":"2024-04-15T23:31:32.869537+0000","last_fullsized":"2024-04-15T23:31:32.869537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881346+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:31.881346+0000","last_peered":"2024-04-15T23:31:31.881346+0000","last_clean":"2024-04-15T23:31:31.881346+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:31.881346+0000","last_undegraded":"2024-04-15T23:31:31.881346+0000","last_fullsized":"2024-04-15T23:31:31.881346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869351+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:32.869351+0000","last_peered":"2024-04-15T23:31:32.869351+0000","last_clean":"2024-04-15T23:31:32.869351+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:32.869351+0000","last_undegraded":"2024-04-15T23:31:32.869351+0000","last_fullsized":"2024-04-15T23:31:32.869351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872629+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:32.872629+0000","last_peered":"2024-04-15T23:31:32.872629+0000","last_clean":"2024-04-15T23:31:32.872629+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:32.872629+0000","last_undegraded":"2024-04-15T23:31:32.872629+0000","last_fullsized":"2024-04-15T23:31:32.872629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873206+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:32.873206+0000","last_peered":"2024-04-15T23:31:32.873206+0000","last_clean":"2024-04-15T23:31:32.873206+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:32.873206+0000","last_undegraded":"2024-04-15T23:31:32.873206+0000","last_fullsized":"2024-04-15T23:31:32.873206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881005+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:31.881005+0000","last_peered":"2024-04-15T23:31:31.881005+0000","last_clean":"2024-04-15T23:31:31.881005+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:31.881005+0000","last_undegraded":"2024-04-15T23:31:31.881005+0000","last_fullsized":"2024-04-15T23:31:31.881005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882332+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:31.882332+0000","last_peered":"2024-04-15T23:31:31.882332+0000","last_clean":"2024-04-15T23:31:31.882332+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:31.882332+0000","last_undegraded":"2024-04-15T23:31:31.882332+0000","last_fullsized":"2024-04-15T23:31:31.882332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881199+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:31.881199+0000","last_peered":"2024-04-15T23:31:31.881199+0000","last_clean":"2024-04-15T23:31:31.881199+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:31.881199+0000","last_undegraded":"2024-04-15T23:31:31.881199+0000","last_fullsized":"2024-04-15T23:31:31.881199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873620+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:32.873620+0000","last_peered":"2024-04-15T23:31:32.873620+0000","last_clean":"2024-04-15T23:31:32.873620+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:32.873620+0000","last_undegraded":"2024-04-15T23:31:32.873620+0000","last_fullsized":"2024-04-15T23:31:32.873620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872743+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:32.872743+0000","last_peered":"2024-04-15T23:31:32.872743+0000","last_clean":"2024-04-15T23:31:32.872743+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:32.872743+0000","last_undegraded":"2024-04-15T23:31:32.872743+0000","last_fullsized":"2024-04-15T23:31:32.872743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873389+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:32.873389+0000","last_peered":"2024-04-15T23:31:32.873389+0000","last_clean":"2024-04-15T23:31:32.873389+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:32.873389+0000","last_undegraded":"2024-04-15T23:31:32.873389+0000","last_fullsized":"2024-04-15T23:31:32.873389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868888+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:32.868888+0000","last_peered":"2024-04-15T23:31:32.868888+0000","last_clean":"2024-04-15T23:31:32.868888+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:32.868888+0000","last_undegraded":"2024-04-15T23:31:32.868888+0000","last_fullsized":"2024-04-15T23:31:32.868888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869420+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:32.869420+0000","last_peered":"2024-04-15T23:31:32.869420+0000","last_clean":"2024-04-15T23:31:32.869420+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:32.869420+0000","last_undegraded":"2024-04-15T23:31:32.869420+0000","last_fullsized":"2024-04-15T23:31:32.869420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873238+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:32.873238+0000","last_peered":"2024-04-15T23:31:32.873238+0000","last_clean":"2024-04-15T23:31:32.873238+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:32.873238+0000","last_undegraded":"2024-04-15T23:31:32.873238+0000","last_fullsized":"2024-04-15T23:31:32.873238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873205+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:32.873205+0000","last_peered":"2024-04-15T23:31:32.873205+0000","last_clean":"2024-04-15T23:31:32.873205+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:32.873205+0000","last_undegraded":"2024-04-15T23:31:32.873205+0000","last_fullsized":"2024-04-15T23:31:32.873205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873417+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:32.873417+0000","last_peered":"2024-04-15T23:31:32.873417+0000","last_clean":"2024-04-15T23:31:32.873417+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:32.873417+0000","last_undegraded":"2024-04-15T23:31:32.873417+0000","last_fullsized":"2024-04-15T23:31:32.873417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881379+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:31.881379+0000","last_peered":"2024-04-15T23:31:31.881379+0000","last_clean":"2024-04-15T23:31:31.881379+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:31.881379+0000","last_undegraded":"2024-04-15T23:31:31.881379+0000","last_fullsized":"2024-04-15T23:31:31.881379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873159+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:32.873159+0000","last_peered":"2024-04-15T23:31:32.873159+0000","last_clean":"2024-04-15T23:31:32.873159+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:32.873159+0000","last_undegraded":"2024-04-15T23:31:32.873159+0000","last_fullsized":"2024-04-15T23:31:32.873159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881106+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:31.881106+0000","last_peered":"2024-04-15T23:31:31.881106+0000","last_clean":"2024-04-15T23:31:31.881106+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:31.881106+0000","last_undegraded":"2024-04-15T23:31:31.881106+0000","last_fullsized":"2024-04-15T23:31:31.881106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869573+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:32.869573+0000","last_peered":"2024-04-15T23:31:32.869573+0000","last_clean":"2024-04-15T23:31:32.869573+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:32.869573+0000","last_undegraded":"2024-04-15T23:31:32.869573+0000","last_fullsized":"2024-04-15T23:31:32.869573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873127+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:32.873127+0000","last_peered":"2024-04-15T23:31:32.873127+0000","last_clean":"2024-04-15T23:31:32.873127+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:32.873127+0000","last_undegraded":"2024-04-15T23:31:32.873127+0000","last_fullsized":"2024-04-15T23:31:32.873127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873569+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:32.873569+0000","last_peered":"2024-04-15T23:31:32.873569+0000","last_clean":"2024-04-15T23:31:32.873569+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:32.873569+0000","last_undegraded":"2024-04-15T23:31:32.873569+0000","last_fullsized":"2024-04-15T23:31:32.873569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868860+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:32.868860+0000","last_peered":"2024-04-15T23:31:32.868860+0000","last_clean":"2024-04-15T23:31:32.868860+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:32.868860+0000","last_undegraded":"2024-04-15T23:31:32.868860+0000","last_fullsized":"2024-04-15T23:31:32.868860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873528+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:32.873528+0000","last_peered":"2024-04-15T23:31:32.873528+0000","last_clean":"2024-04-15T23:31:32.873528+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:32.873528+0000","last_undegraded":"2024-04-15T23:31:32.873528+0000","last_fullsized":"2024-04-15T23:31:32.873528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873011+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:32.873011+0000","last_peered":"2024-04-15T23:31:32.873011+0000","last_clean":"2024-04-15T23:31:32.873011+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:32.873011+0000","last_undegraded":"2024-04-15T23:31:32.873011+0000","last_fullsized":"2024-04-15T23:31:32.873011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868778+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:32.868778+0000","last_peered":"2024-04-15T23:31:32.868778+0000","last_clean":"2024-04-15T23:31:32.868778+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:32.868778+0000","last_undegraded":"2024-04-15T23:31:32.868778+0000","last_fullsized":"2024-04-15T23:31:32.868778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882190+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:31.882190+0000","last_peered":"2024-04-15T23:31:31.882190+0000","last_clean":"2024-04-15T23:31:31.882190+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:31.882190+0000","last_undegraded":"2024-04-15T23:31:31.882190+0000","last_fullsized":"2024-04-15T23:31:31.882190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868848+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:32.868848+0000","last_peered":"2024-04-15T23:31:32.868848+0000","last_clean":"2024-04-15T23:31:32.868848+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:32.868848+0000","last_undegraded":"2024-04-15T23:31:32.868848+0000","last_fullsized":"2024-04-15T23:31:32.868848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881242+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:31.881242+0000","last_peered":"2024-04-15T23:31:31.881242+0000","last_clean":"2024-04-15T23:31:31.881242+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:31.881242+0000","last_undegraded":"2024-04-15T23:31:31.881242+0000","last_fullsized":"2024-04-15T23:31:31.881242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869567+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:32.869567+0000","last_peered":"2024-04-15T23:31:32.869567+0000","last_clean":"2024-04-15T23:31:32.869567+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:32.869567+0000","last_undegraded":"2024-04-15T23:31:32.869567+0000","last_fullsized":"2024-04-15T23:31:32.869567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873279+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:32.873279+0000","last_peered":"2024-04-15T23:31:32.873279+0000","last_clean":"2024-04-15T23:31:32.873279+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:32.873279+0000","last_undegraded":"2024-04-15T23:31:32.873279+0000","last_fullsized":"2024-04-15T23:31:32.873279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873547+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:32.873547+0000","last_peered":"2024-04-15T23:31:32.873547+0000","last_clean":"2024-04-15T23:31:32.873547+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:32.873547+0000","last_undegraded":"2024-04-15T23:31:32.873547+0000","last_fullsized":"2024-04-15T23:31:32.873547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869117+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:32.869117+0000","last_peered":"2024-04-15T23:31:32.869117+0000","last_clean":"2024-04-15T23:31:32.869117+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:32.869117+0000","last_undegraded":"2024-04-15T23:31:32.869117+0000","last_fullsized":"2024-04-15T23:31:32.869117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873596+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:32.873596+0000","last_peered":"2024-04-15T23:31:32.873596+0000","last_clean":"2024-04-15T23:31:32.873596+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:32.873596+0000","last_undegraded":"2024-04-15T23:31:32.873596+0000","last_fullsized":"2024-04-15T23:31:32.873596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869211+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:32.869211+0000","last_peered":"2024-04-15T23:31:32.869211+0000","last_clean":"2024-04-15T23:31:32.869211+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:32.869211+0000","last_undegraded":"2024-04-15T23:31:32.869211+0000","last_fullsized":"2024-04-15T23:31:32.869211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881418+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:31.881418+0000","last_peered":"2024-04-15T23:31:31.881418+0000","last_clean":"2024-04-15T23:31:31.881418+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:31.881418+0000","last_undegraded":"2024-04-15T23:31:31.881418+0000","last_fullsized":"2024-04-15T23:31:31.881418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869239+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:32.869239+0000","last_peered":"2024-04-15T23:31:32.869239+0000","last_clean":"2024-04-15T23:31:32.869239+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:32.869239+0000","last_undegraded":"2024-04-15T23:31:32.869239+0000","last_fullsized":"2024-04-15T23:31:32.869239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882374+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:31.882374+0000","last_peered":"2024-04-15T23:31:31.882374+0000","last_clean":"2024-04-15T23:31:31.882374+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:31.882374+0000","last_undegraded":"2024-04-15T23:31:31.882374+0000","last_fullsized":"2024-04-15T23:31:31.882374+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881543+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:31.881543+0000","last_peered":"2024-04-15T23:31:31.881543+0000","last_clean":"2024-04-15T23:31:31.881543+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:31.881543+0000","last_undegraded":"2024-04-15T23:31:31.881543+0000","last_fullsized":"2024-04-15T23:31:31.881543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869884+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:32.869884+0000","last_peered":"2024-04-15T23:31:32.869884+0000","last_clean":"2024-04-15T23:31:32.869884+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:32.869884+0000","last_undegraded":"2024-04-15T23:31:32.869884+0000","last_fullsized":"2024-04-15T23:31:32.869884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869595+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:32.869595+0000","last_peered":"2024-04-15T23:31:32.869595+0000","last_clean":"2024-04-15T23:31:32.869595+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:32.869595+0000","last_undegraded":"2024-04-15T23:31:32.869595+0000","last_fullsized":"2024-04-15T23:31:32.869595+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868519+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:32.868519+0000","last_peered":"2024-04-15T23:31:32.868519+0000","last_clean":"2024-04-15T23:31:32.868519+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:32.868519+0000","last_undegraded":"2024-04-15T23:31:32.868519+0000","last_fullsized":"2024-04-15T23:31:32.868519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.871245+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:32.871245+0000","last_peered":"2024-04-15T23:31:32.871245+0000","last_clean":"2024-04-15T23:31:32.871245+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:32.871245+0000","last_undegraded":"2024-04-15T23:31:32.871245+0000","last_fullsized":"2024-04-15T23:31:32.871245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873285+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:32.873285+0000","last_peered":"2024-04-15T23:31:32.873285+0000","last_clean":"2024-04-15T23:31:32.873285+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:32.873285+0000","last_undegraded":"2024-04-15T23:31:32.873285+0000","last_fullsized":"2024-04-15T23:31:32.873285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881196+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:31.881196+0000","last_peered":"2024-04-15T23:31:31.881196+0000","last_clean":"2024-04-15T23:31:31.881196+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:31.881196+0000","last_undegraded":"2024-04-15T23:31:31.881196+0000","last_fullsized":"2024-04-15T23:31:31.881196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873078+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:32.873078+0000","last_peered":"2024-04-15T23:31:32.873078+0000","last_clean":"2024-04-15T23:31:32.873078+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:32.873078+0000","last_undegraded":"2024-04-15T23:31:32.873078+0000","last_fullsized":"2024-04-15T23:31:32.873078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873349+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:32.873349+0000","last_peered":"2024-04-15T23:31:32.873349+0000","last_clean":"2024-04-15T23:31:32.873349+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:32.873349+0000","last_undegraded":"2024-04-15T23:31:32.873349+0000","last_fullsized":"2024-04-15T23:31:32.873349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868520+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:32.868520+0000","last_peered":"2024-04-15T23:31:32.868520+0000","last_clean":"2024-04-15T23:31:32.868520+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:32.868520+0000","last_undegraded":"2024-04-15T23:31:32.868520+0000","last_fullsized":"2024-04-15T23:31:32.868520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882316+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:31.882316+0000","last_peered":"2024-04-15T23:31:31.882316+0000","last_clean":"2024-04-15T23:31:31.882316+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:31.882316+0000","last_undegraded":"2024-04-15T23:31:31.882316+0000","last_fullsized":"2024-04-15T23:31:31.882316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873151+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:32.873151+0000","last_peered":"2024-04-15T23:31:32.873151+0000","last_clean":"2024-04-15T23:31:32.873151+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:32.873151+0000","last_undegraded":"2024-04-15T23:31:32.873151+0000","last_fullsized":"2024-04-15T23:31:32.873151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868637+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:32.868637+0000","last_peered":"2024-04-15T23:31:32.868637+0000","last_clean":"2024-04-15T23:31:32.868637+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:32.868637+0000","last_undegraded":"2024-04-15T23:31:32.868637+0000","last_fullsized":"2024-04-15T23:31:32.868637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869780+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:32.869780+0000","last_peered":"2024-04-15T23:31:32.869780+0000","last_clean":"2024-04-15T23:31:32.869780+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:32.869780+0000","last_undegraded":"2024-04-15T23:31:32.869780+0000","last_fullsized":"2024-04-15T23:31:32.869780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868441+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:32.868441+0000","last_peered":"2024-04-15T23:31:32.868441+0000","last_clean":"2024-04-15T23:31:32.868441+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:32.868441+0000","last_undegraded":"2024-04-15T23:31:32.868441+0000","last_fullsized":"2024-04-15T23:31:32.868441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882405+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:31.882405+0000","last_peered":"2024-04-15T23:31:31.882405+0000","last_clean":"2024-04-15T23:31:31.882405+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:31.882405+0000","last_undegraded":"2024-04-15T23:31:31.882405+0000","last_fullsized":"2024-04-15T23:31:31.882405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868560+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:32.868560+0000","last_peered":"2024-04-15T23:31:32.868560+0000","last_clean":"2024-04-15T23:31:32.868560+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:32.868560+0000","last_undegraded":"2024-04-15T23:31:32.868560+0000","last_fullsized":"2024-04-15T23:31:32.868560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869302+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:32.869302+0000","last_peered":"2024-04-15T23:31:32.869302+0000","last_clean":"2024-04-15T23:31:32.869302+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:32.869302+0000","last_undegraded":"2024-04-15T23:31:32.869302+0000","last_fullsized":"2024-04-15T23:31:32.869302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868627+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:32.868627+0000","last_peered":"2024-04-15T23:31:32.868627+0000","last_clean":"2024-04-15T23:31:32.868627+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:32.868627+0000","last_undegraded":"2024-04-15T23:31:32.868627+0000","last_fullsized":"2024-04-15T23:31:32.868627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882022+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:31.882022+0000","last_peered":"2024-04-15T23:31:31.882022+0000","last_clean":"2024-04-15T23:31:31.882022+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:31.882022+0000","last_undegraded":"2024-04-15T23:31:31.882022+0000","last_fullsized":"2024-04-15T23:31:31.882022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881588+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:31.881588+0000","last_peered":"2024-04-15T23:31:31.881588+0000","last_clean":"2024-04-15T23:31:31.881588+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:31.881588+0000","last_undegraded":"2024-04-15T23:31:31.881588+0000","last_fullsized":"2024-04-15T23:31:31.881588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881564+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:31.881564+0000","last_peered":"2024-04-15T23:31:31.881564+0000","last_clean":"2024-04-15T23:31:31.881564+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:31.881564+0000","last_undegraded":"2024-04-15T23:31:31.881564+0000","last_fullsized":"2024-04-15T23:31:31.881564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881687+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:31.881687+0000","last_peered":"2024-04-15T23:31:31.881687+0000","last_clean":"2024-04-15T23:31:31.881687+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:31.881687+0000","last_undegraded":"2024-04-15T23:31:31.881687+0000","last_fullsized":"2024-04-15T23:31:31.881687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873275+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:32.873275+0000","last_peered":"2024-04-15T23:31:32.873275+0000","last_clean":"2024-04-15T23:31:32.873275+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:32.873275+0000","last_undegraded":"2024-04-15T23:31:32.873275+0000","last_fullsized":"2024-04-15T23:31:32.873275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873266+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:32.873266+0000","last_peered":"2024-04-15T23:31:32.873266+0000","last_clean":"2024-04-15T23:31:32.873266+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:32.873266+0000","last_undegraded":"2024-04-15T23:31:32.873266+0000","last_fullsized":"2024-04-15T23:31:32.873266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873207+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:32.873207+0000","last_peered":"2024-04-15T23:31:32.873207+0000","last_clean":"2024-04-15T23:31:32.873207+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:32.873207+0000","last_undegraded":"2024-04-15T23:31:32.873207+0000","last_fullsized":"2024-04-15T23:31:32.873207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882153+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:31.882153+0000","last_peered":"2024-04-15T23:31:31.882153+0000","last_clean":"2024-04-15T23:31:31.882153+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:31.882153+0000","last_undegraded":"2024-04-15T23:31:31.882153+0000","last_fullsized":"2024-04-15T23:31:31.882153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881611+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:31.881611+0000","last_peered":"2024-04-15T23:31:31.881611+0000","last_clean":"2024-04-15T23:31:31.881611+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:31.881611+0000","last_undegraded":"2024-04-15T23:31:31.881611+0000","last_fullsized":"2024-04-15T23:31:31.881611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869520+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:32.869520+0000","last_peered":"2024-04-15T23:31:32.869520+0000","last_clean":"2024-04-15T23:31:32.869520+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:32.869520+0000","last_undegraded":"2024-04-15T23:31:32.869520+0000","last_fullsized":"2024-04-15T23:31:32.869520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873123+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:32.873123+0000","last_peered":"2024-04-15T23:31:32.873123+0000","last_clean":"2024-04-15T23:31:32.873123+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:32.873123+0000","last_undegraded":"2024-04-15T23:31:32.873123+0000","last_fullsized":"2024-04-15T23:31:32.873123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869698+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:32.869698+0000","last_peered":"2024-04-15T23:31:32.869698+0000","last_clean":"2024-04-15T23:31:32.869698+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:32.869698+0000","last_undegraded":"2024-04-15T23:31:32.869698+0000","last_fullsized":"2024-04-15T23:31:32.869698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:40.706 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T23:31:40.706 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-15T23:31:40.707 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-15T23:31:40.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-15T23:31:41.062 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:41.062 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-15T23:31:41.075 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-15T23:31:41.075 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:41.361 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:41.361 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:31.867515+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T23:31:41.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T23:31:41.661 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-04-15T23:31:41.674 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-15T23:31:41.965 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 8 2024-04-15T23:31:41.978 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T23:31:42.266 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-04-15T23:31:42.278 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T23:31:42.565 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-04-15T23:31:42.578 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:31:42.896 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:42.897 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T23:31:30.206590+0000","modified":"2024-04-15T23:31:32.213535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4218,"qdb_cluster":[4218]},"id":1}]} 2024-04-15T23:31:42.897 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-04-15T23:31:42.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:43.195 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:43.196 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:31.867515+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:43.208 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T23:31:43.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T23:31:43.495 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-04-15T23:31:43.508 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-15T23:31:43.795 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 8 2024-04-15T23:31:43.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T23:31:44.095 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-04-15T23:31:44.110 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T23:31:44.400 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-04-15T23:31:44.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:31:44.732 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:44.733 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T23:31:30.206590+0000","modified":"2024-04-15T23:31:32.213535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4218,"qdb_cluster":[4218]},"id":1}]} 2024-04-15T23:31:44.733 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-04-15T23:31:44.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:31:45.035 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:45.035 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":15,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:31:31.867515+0000","last_up_change":"2024-04-15T23:31:23.575432+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:31:45.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:31:45.368 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:45.369 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T23:31:30.206590+0000","modified":"2024-04-15T23:31:32.213535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4218,"qdb_cluster":[4218]},"id":1}]} 2024-04-15T23:31:45.369 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-04-15T23:31:45.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-15T23:31:30.206590+0000', 'modified': '2024-04-15T23:31:32.213535+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4218': {'gid': 4218, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6803/1489653538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6802', 'nonce': 1489653538}, {'type': 'v1', 'addr': '172.21.15.102:6803', 'nonce': 1489653538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4218, 'qdb_cluster': [4218]} 2024-04-15T23:31:45.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-15T23:31:45.483 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-15T23:31:45.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:45.614+0000 7fb2bffff640 0 client.4466 ms_handle_reset on v2:172.21.15.102:6802/1489653538 2024-04-15T23:31:45.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:45.637+0000 7fb2bffff640 0 client.4472 ms_handle_reset on v2:172.21.15.102:6802/1489653538 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4218, 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 14.774722049999999, 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 5, 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 15, 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 15, 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 19.952253346999999 2024-04-15T23:31:45.621 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:31:45.633 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-15T23:31:45.650 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-15T23:31:45.650 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a9a752df26c63acad72e1b3569fd79a515ca0765'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '461a84e6fbbf089011eafd13b98169fb9e9b8cc9'}} 2024-04-15T23:31:45.650 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-15T23:31:45.650 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-15T23:31:45.650 DEBUG:teuthology.orchestra.run.smithi102:> sync 2024-04-15T23:31:45.750 DEBUG:teuthology.orchestra.run.smithi107:> sync 2024-04-15T23:31:45.876 DEBUG:teuthology.orchestra.run.smithi115:> sync 2024-04-15T23:31:46.016 DEBUG:teuthology.orchestra.run.smithi195:> sync 2024-04-15T23:31:46.136 DEBUG:tasks.thrashosds:checking console status of smithi102 2024-04-15T23:31:46.136 DEBUG:teuthology.orchestra.console.smithi102:Waiting for login prompt 2024-04-15T23:31:46.136 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi102 2024-04-15T23:31:46.240 DEBUG:teuthology.orchestra.console.smithi102:expect before: [Enter `^Ec?' for help] 2024-04-15T23:31:46.241 DEBUG:teuthology.orchestra.console.smithi102:expect after: smithi102 login: 2024-04-15T23:31:46.293 DEBUG:teuthology.orchestra.console.smithi102:console disconnect output: [Enter `^Ec?' for help] smithi102 login: [disconnect] 2024-04-15T23:31:46.394 DEBUG:tasks.thrashosds:checking console status of smithi107 2024-04-15T23:31:46.394 DEBUG:teuthology.orchestra.console.smithi107:Waiting for login prompt 2024-04-15T23:31:46.394 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi107 2024-04-15T23:31:46.475 DEBUG:teuthology.orchestra.console.smithi107:expect before: [Enter `^Ec?' for help] 2024-04-15T23:31:46.476 DEBUG:teuthology.orchestra.console.smithi107:expect after: smithi107 login: 2024-04-15T23:31:46.528 DEBUG:teuthology.orchestra.console.smithi107:console disconnect output: [Enter `^Ec?' for help] smithi107 login: [disconnect] 2024-04-15T23:31:46.629 DEBUG:tasks.thrashosds:checking console status of smithi115 2024-04-15T23:31:46.629 DEBUG:teuthology.orchestra.console.smithi115:Waiting for login prompt 2024-04-15T23:31:46.629 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi115 2024-04-15T23:31:46.724 DEBUG:teuthology.orchestra.console.smithi115:expect before: [Enter `^Ec?' for help] 2024-04-15T23:31:46.725 DEBUG:teuthology.orchestra.console.smithi115:expect after: smithi115 login: 2024-04-15T23:31:46.777 DEBUG:teuthology.orchestra.console.smithi115:console disconnect output: [Enter `^Ec?' for help] smithi115 login: [disconnect] 2024-04-15T23:31:46.878 DEBUG:tasks.thrashosds:checking console status of smithi195 2024-04-15T23:31:46.878 DEBUG:teuthology.orchestra.console.smithi195:Waiting for login prompt 2024-04-15T23:31:46.878 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi195 2024-04-15T23:31:46.967 DEBUG:teuthology.orchestra.console.smithi195:expect before: [Enter `^Ec?' for help] 2024-04-15T23:31:46.967 DEBUG:teuthology.orchestra.console.smithi195:expect after: smithi195 login: 2024-04-15T23:31:47.019 DEBUG:teuthology.orchestra.console.smithi195:console disconnect output: [Enter `^Ec?' for help] smithi195 login: [disconnect] 2024-04-15T23:31:47.120 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-15T23:31:47.436 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-15T23:31:47.436 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T23:31:47.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:47.727 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:47.729 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:47.737 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-15T23:31:45.771049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882232+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:31.882232+0000","last_peered":"2024-04-15T23:31:31.882232+0000","last_clean":"2024-04-15T23:31:31.882232+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:31.882232+0000","last_undegraded":"2024-04-15T23:31:31.882232+0000","last_fullsized":"2024-04-15T23:31:31.882232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881959+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:31.881959+0000","last_peered":"2024-04-15T23:31:31.881959+0000","last_clean":"2024-04-15T23:31:31.881959+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:31.881959+0000","last_undegraded":"2024-04-15T23:31:31.881959+0000","last_fullsized":"2024-04-15T23:31:31.881959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873116+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:32.873116+0000","last_peered":"2024-04-15T23:31:32.873116+0000","last_clean":"2024-04-15T23:31:32.873116+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:32.873116+0000","last_undegraded":"2024-04-15T23:31:32.873116+0000","last_fullsized":"2024-04-15T23:31:32.873116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872895+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:32.872895+0000","last_peered":"2024-04-15T23:31:32.872895+0000","last_clean":"2024-04-15T23:31:32.872895+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:32.872895+0000","last_undegraded":"2024-04-15T23:31:32.872895+0000","last_fullsized":"2024-04-15T23:31:32.872895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881576+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:31.881576+0000","last_peered":"2024-04-15T23:31:31.881576+0000","last_clean":"2024-04-15T23:31:31.881576+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:31.881576+0000","last_undegraded":"2024-04-15T23:31:31.881576+0000","last_fullsized":"2024-04-15T23:31:31.881576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872413+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:32.872413+0000","last_peered":"2024-04-15T23:31:32.872413+0000","last_clean":"2024-04-15T23:31:32.872413+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:32.872413+0000","last_undegraded":"2024-04-15T23:31:32.872413+0000","last_fullsized":"2024-04-15T23:31:32.872413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872547+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:32.872547+0000","last_peered":"2024-04-15T23:31:32.872547+0000","last_clean":"2024-04-15T23:31:32.872547+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:32.872547+0000","last_undegraded":"2024-04-15T23:31:32.872547+0000","last_fullsized":"2024-04-15T23:31:32.872547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872247+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:32.872247+0000","last_peered":"2024-04-15T23:31:32.872247+0000","last_clean":"2024-04-15T23:31:32.872247+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:32.872247+0000","last_undegraded":"2024-04-15T23:31:32.872247+0000","last_fullsized":"2024-04-15T23:31:32.872247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869374+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:32.869374+0000","last_peered":"2024-04-15T23:31:32.869374+0000","last_clean":"2024-04-15T23:31:32.869374+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:32.869374+0000","last_undegraded":"2024-04-15T23:31:32.869374+0000","last_fullsized":"2024-04-15T23:31:32.869374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881987+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:31.881987+0000","last_peered":"2024-04-15T23:31:31.881987+0000","last_clean":"2024-04-15T23:31:31.881987+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:31.881987+0000","last_undegraded":"2024-04-15T23:31:31.881987+0000","last_fullsized":"2024-04-15T23:31:31.881987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873095+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:32.873095+0000","last_peered":"2024-04-15T23:31:32.873095+0000","last_clean":"2024-04-15T23:31:32.873095+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:32.873095+0000","last_undegraded":"2024-04-15T23:31:32.873095+0000","last_fullsized":"2024-04-15T23:31:32.873095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881697+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:31.881697+0000","last_peered":"2024-04-15T23:31:31.881697+0000","last_clean":"2024-04-15T23:31:31.881697+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:31.881697+0000","last_undegraded":"2024-04-15T23:31:31.881697+0000","last_fullsized":"2024-04-15T23:31:31.881697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881360+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:31.881360+0000","last_peered":"2024-04-15T23:31:31.881360+0000","last_clean":"2024-04-15T23:31:31.881360+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:31.881360+0000","last_undegraded":"2024-04-15T23:31:31.881360+0000","last_fullsized":"2024-04-15T23:31:31.881360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872570+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:32.872570+0000","last_peered":"2024-04-15T23:31:32.872570+0000","last_clean":"2024-04-15T23:31:32.872570+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:32.872570+0000","last_undegraded":"2024-04-15T23:31:32.872570+0000","last_fullsized":"2024-04-15T23:31:32.872570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872656+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:32.872656+0000","last_peered":"2024-04-15T23:31:32.872656+0000","last_clean":"2024-04-15T23:31:32.872656+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:32.872656+0000","last_undegraded":"2024-04-15T23:31:32.872656+0000","last_fullsized":"2024-04-15T23:31:32.872656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872467+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:32.872467+0000","last_peered":"2024-04-15T23:31:32.872467+0000","last_clean":"2024-04-15T23:31:32.872467+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:32.872467+0000","last_undegraded":"2024-04-15T23:31:32.872467+0000","last_fullsized":"2024-04-15T23:31:32.872467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869858+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:32.869858+0000","last_peered":"2024-04-15T23:31:32.869858+0000","last_clean":"2024-04-15T23:31:32.869858+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:32.869858+0000","last_undegraded":"2024-04-15T23:31:32.869858+0000","last_fullsized":"2024-04-15T23:31:32.869858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882220+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:31.882220+0000","last_peered":"2024-04-15T23:31:31.882220+0000","last_clean":"2024-04-15T23:31:31.882220+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:31.882220+0000","last_undegraded":"2024-04-15T23:31:31.882220+0000","last_fullsized":"2024-04-15T23:31:31.882220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869019+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:32.869019+0000","last_peered":"2024-04-15T23:31:32.869019+0000","last_clean":"2024-04-15T23:31:32.869019+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:32.869019+0000","last_undegraded":"2024-04-15T23:31:32.869019+0000","last_fullsized":"2024-04-15T23:31:32.869019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873131+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:32.873131+0000","last_peered":"2024-04-15T23:31:32.873131+0000","last_clean":"2024-04-15T23:31:32.873131+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:32.873131+0000","last_undegraded":"2024-04-15T23:31:32.873131+0000","last_fullsized":"2024-04-15T23:31:32.873131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873464+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:32.873464+0000","last_peered":"2024-04-15T23:31:32.873464+0000","last_clean":"2024-04-15T23:31:32.873464+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:32.873464+0000","last_undegraded":"2024-04-15T23:31:32.873464+0000","last_fullsized":"2024-04-15T23:31:32.873464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881386+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:31.881386+0000","last_peered":"2024-04-15T23:31:31.881386+0000","last_clean":"2024-04-15T23:31:31.881386+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:31.881386+0000","last_undegraded":"2024-04-15T23:31:31.881386+0000","last_fullsized":"2024-04-15T23:31:31.881386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868278+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:32.868278+0000","last_peered":"2024-04-15T23:31:32.868278+0000","last_clean":"2024-04-15T23:31:32.868278+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:32.868278+0000","last_undegraded":"2024-04-15T23:31:32.868278+0000","last_fullsized":"2024-04-15T23:31:32.868278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.880945+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:31.880945+0000","last_peered":"2024-04-15T23:31:31.880945+0000","last_clean":"2024-04-15T23:31:31.880945+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:31.880945+0000","last_undegraded":"2024-04-15T23:31:31.880945+0000","last_fullsized":"2024-04-15T23:31:31.880945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882304+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:31.882304+0000","last_peered":"2024-04-15T23:31:31.882304+0000","last_clean":"2024-04-15T23:31:31.882304+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:31.882304+0000","last_undegraded":"2024-04-15T23:31:31.882304+0000","last_fullsized":"2024-04-15T23:31:31.882304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869414+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869414+0000","last_peered":"2024-04-15T23:31:32.869414+0000","last_clean":"2024-04-15T23:31:32.869414+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:32.869414+0000","last_undegraded":"2024-04-15T23:31:32.869414+0000","last_fullsized":"2024-04-15T23:31:32.869414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873492+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:32.873492+0000","last_peered":"2024-04-15T23:31:32.873492+0000","last_clean":"2024-04-15T23:31:32.873492+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:32.873492+0000","last_undegraded":"2024-04-15T23:31:32.873492+0000","last_fullsized":"2024-04-15T23:31:32.873492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881984+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:31.881984+0000","last_peered":"2024-04-15T23:31:31.881984+0000","last_clean":"2024-04-15T23:31:31.881984+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:31.881984+0000","last_undegraded":"2024-04-15T23:31:31.881984+0000","last_fullsized":"2024-04-15T23:31:31.881984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869197+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:32.869197+0000","last_peered":"2024-04-15T23:31:32.869197+0000","last_clean":"2024-04-15T23:31:32.869197+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:32.869197+0000","last_undegraded":"2024-04-15T23:31:32.869197+0000","last_fullsized":"2024-04-15T23:31:32.869197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881682+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:31.881682+0000","last_peered":"2024-04-15T23:31:31.881682+0000","last_clean":"2024-04-15T23:31:31.881682+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:31.881682+0000","last_undegraded":"2024-04-15T23:31:31.881682+0000","last_fullsized":"2024-04-15T23:31:31.881682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868338+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:32.868338+0000","last_peered":"2024-04-15T23:31:32.868338+0000","last_clean":"2024-04-15T23:31:32.868338+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:32.868338+0000","last_undegraded":"2024-04-15T23:31:32.868338+0000","last_fullsized":"2024-04-15T23:31:32.868338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872437+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:32.872437+0000","last_peered":"2024-04-15T23:31:32.872437+0000","last_clean":"2024-04-15T23:31:32.872437+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:32.872437+0000","last_undegraded":"2024-04-15T23:31:32.872437+0000","last_fullsized":"2024-04-15T23:31:32.872437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881756+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:31.881756+0000","last_peered":"2024-04-15T23:31:31.881756+0000","last_clean":"2024-04-15T23:31:31.881756+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:31.881756+0000","last_undegraded":"2024-04-15T23:31:31.881756+0000","last_fullsized":"2024-04-15T23:31:31.881756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873498+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:32.873498+0000","last_peered":"2024-04-15T23:31:32.873498+0000","last_clean":"2024-04-15T23:31:32.873498+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:32.873498+0000","last_undegraded":"2024-04-15T23:31:32.873498+0000","last_fullsized":"2024-04-15T23:31:32.873498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882157+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:31.882157+0000","last_peered":"2024-04-15T23:31:31.882157+0000","last_clean":"2024-04-15T23:31:31.882157+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:31.882157+0000","last_undegraded":"2024-04-15T23:31:31.882157+0000","last_fullsized":"2024-04-15T23:31:31.882157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868654+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:32.868654+0000","last_peered":"2024-04-15T23:31:32.868654+0000","last_clean":"2024-04-15T23:31:32.868654+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:32.868654+0000","last_undegraded":"2024-04-15T23:31:32.868654+0000","last_fullsized":"2024-04-15T23:31:32.868654+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869537+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869537+0000","last_peered":"2024-04-15T23:31:32.869537+0000","last_clean":"2024-04-15T23:31:32.869537+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:32.869537+0000","last_undegraded":"2024-04-15T23:31:32.869537+0000","last_fullsized":"2024-04-15T23:31:32.869537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881346+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:31.881346+0000","last_peered":"2024-04-15T23:31:31.881346+0000","last_clean":"2024-04-15T23:31:31.881346+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:31.881346+0000","last_undegraded":"2024-04-15T23:31:31.881346+0000","last_fullsized":"2024-04-15T23:31:31.881346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869351+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:32.869351+0000","last_peered":"2024-04-15T23:31:32.869351+0000","last_clean":"2024-04-15T23:31:32.869351+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:32.869351+0000","last_undegraded":"2024-04-15T23:31:32.869351+0000","last_fullsized":"2024-04-15T23:31:32.869351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872629+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:32.872629+0000","last_peered":"2024-04-15T23:31:32.872629+0000","last_clean":"2024-04-15T23:31:32.872629+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:32.872629+0000","last_undegraded":"2024-04-15T23:31:32.872629+0000","last_fullsized":"2024-04-15T23:31:32.872629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873206+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:32.873206+0000","last_peered":"2024-04-15T23:31:32.873206+0000","last_clean":"2024-04-15T23:31:32.873206+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:32.873206+0000","last_undegraded":"2024-04-15T23:31:32.873206+0000","last_fullsized":"2024-04-15T23:31:32.873206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881005+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:31.881005+0000","last_peered":"2024-04-15T23:31:31.881005+0000","last_clean":"2024-04-15T23:31:31.881005+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:31.881005+0000","last_undegraded":"2024-04-15T23:31:31.881005+0000","last_fullsized":"2024-04-15T23:31:31.881005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882332+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:31.882332+0000","last_peered":"2024-04-15T23:31:31.882332+0000","last_clean":"2024-04-15T23:31:31.882332+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:31.882332+0000","last_undegraded":"2024-04-15T23:31:31.882332+0000","last_fullsized":"2024-04-15T23:31:31.882332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881199+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:31.881199+0000","last_peered":"2024-04-15T23:31:31.881199+0000","last_clean":"2024-04-15T23:31:31.881199+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:31.881199+0000","last_undegraded":"2024-04-15T23:31:31.881199+0000","last_fullsized":"2024-04-15T23:31:31.881199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873620+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:32.873620+0000","last_peered":"2024-04-15T23:31:32.873620+0000","last_clean":"2024-04-15T23:31:32.873620+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:32.873620+0000","last_undegraded":"2024-04-15T23:31:32.873620+0000","last_fullsized":"2024-04-15T23:31:32.873620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872743+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:32.872743+0000","last_peered":"2024-04-15T23:31:32.872743+0000","last_clean":"2024-04-15T23:31:32.872743+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:32.872743+0000","last_undegraded":"2024-04-15T23:31:32.872743+0000","last_fullsized":"2024-04-15T23:31:32.872743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873389+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:32.873389+0000","last_peered":"2024-04-15T23:31:32.873389+0000","last_clean":"2024-04-15T23:31:32.873389+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:32.873389+0000","last_undegraded":"2024-04-15T23:31:32.873389+0000","last_fullsized":"2024-04-15T23:31:32.873389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868888+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:32.868888+0000","last_peered":"2024-04-15T23:31:32.868888+0000","last_clean":"2024-04-15T23:31:32.868888+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:32.868888+0000","last_undegraded":"2024-04-15T23:31:32.868888+0000","last_fullsized":"2024-04-15T23:31:32.868888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869420+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:32.869420+0000","last_peered":"2024-04-15T23:31:32.869420+0000","last_clean":"2024-04-15T23:31:32.869420+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:32.869420+0000","last_undegraded":"2024-04-15T23:31:32.869420+0000","last_fullsized":"2024-04-15T23:31:32.869420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873238+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:32.873238+0000","last_peered":"2024-04-15T23:31:32.873238+0000","last_clean":"2024-04-15T23:31:32.873238+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:32.873238+0000","last_undegraded":"2024-04-15T23:31:32.873238+0000","last_fullsized":"2024-04-15T23:31:32.873238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873205+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:32.873205+0000","last_peered":"2024-04-15T23:31:32.873205+0000","last_clean":"2024-04-15T23:31:32.873205+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:32.873205+0000","last_undegraded":"2024-04-15T23:31:32.873205+0000","last_fullsized":"2024-04-15T23:31:32.873205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873417+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:32.873417+0000","last_peered":"2024-04-15T23:31:32.873417+0000","last_clean":"2024-04-15T23:31:32.873417+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:32.873417+0000","last_undegraded":"2024-04-15T23:31:32.873417+0000","last_fullsized":"2024-04-15T23:31:32.873417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881379+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:31.881379+0000","last_peered":"2024-04-15T23:31:31.881379+0000","last_clean":"2024-04-15T23:31:31.881379+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:31.881379+0000","last_undegraded":"2024-04-15T23:31:31.881379+0000","last_fullsized":"2024-04-15T23:31:31.881379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873159+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:32.873159+0000","last_peered":"2024-04-15T23:31:32.873159+0000","last_clean":"2024-04-15T23:31:32.873159+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:32.873159+0000","last_undegraded":"2024-04-15T23:31:32.873159+0000","last_fullsized":"2024-04-15T23:31:32.873159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881106+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:31.881106+0000","last_peered":"2024-04-15T23:31:31.881106+0000","last_clean":"2024-04-15T23:31:31.881106+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:31.881106+0000","last_undegraded":"2024-04-15T23:31:31.881106+0000","last_fullsized":"2024-04-15T23:31:31.881106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869573+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:32.869573+0000","last_peered":"2024-04-15T23:31:32.869573+0000","last_clean":"2024-04-15T23:31:32.869573+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:32.869573+0000","last_undegraded":"2024-04-15T23:31:32.869573+0000","last_fullsized":"2024-04-15T23:31:32.869573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873127+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:32.873127+0000","last_peered":"2024-04-15T23:31:32.873127+0000","last_clean":"2024-04-15T23:31:32.873127+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:32.873127+0000","last_undegraded":"2024-04-15T23:31:32.873127+0000","last_fullsized":"2024-04-15T23:31:32.873127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873569+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:32.873569+0000","last_peered":"2024-04-15T23:31:32.873569+0000","last_clean":"2024-04-15T23:31:32.873569+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:32.873569+0000","last_undegraded":"2024-04-15T23:31:32.873569+0000","last_fullsized":"2024-04-15T23:31:32.873569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868860+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:32.868860+0000","last_peered":"2024-04-15T23:31:32.868860+0000","last_clean":"2024-04-15T23:31:32.868860+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:32.868860+0000","last_undegraded":"2024-04-15T23:31:32.868860+0000","last_fullsized":"2024-04-15T23:31:32.868860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873528+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:32.873528+0000","last_peered":"2024-04-15T23:31:32.873528+0000","last_clean":"2024-04-15T23:31:32.873528+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:32.873528+0000","last_undegraded":"2024-04-15T23:31:32.873528+0000","last_fullsized":"2024-04-15T23:31:32.873528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873011+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:32.873011+0000","last_peered":"2024-04-15T23:31:32.873011+0000","last_clean":"2024-04-15T23:31:32.873011+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:32.873011+0000","last_undegraded":"2024-04-15T23:31:32.873011+0000","last_fullsized":"2024-04-15T23:31:32.873011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868778+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:32.868778+0000","last_peered":"2024-04-15T23:31:32.868778+0000","last_clean":"2024-04-15T23:31:32.868778+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:32.868778+0000","last_undegraded":"2024-04-15T23:31:32.868778+0000","last_fullsized":"2024-04-15T23:31:32.868778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882190+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:31.882190+0000","last_peered":"2024-04-15T23:31:31.882190+0000","last_clean":"2024-04-15T23:31:31.882190+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:31.882190+0000","last_undegraded":"2024-04-15T23:31:31.882190+0000","last_fullsized":"2024-04-15T23:31:31.882190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868848+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:32.868848+0000","last_peered":"2024-04-15T23:31:32.868848+0000","last_clean":"2024-04-15T23:31:32.868848+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:32.868848+0000","last_undegraded":"2024-04-15T23:31:32.868848+0000","last_fullsized":"2024-04-15T23:31:32.868848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881242+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:31.881242+0000","last_peered":"2024-04-15T23:31:31.881242+0000","last_clean":"2024-04-15T23:31:31.881242+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:31.881242+0000","last_undegraded":"2024-04-15T23:31:31.881242+0000","last_fullsized":"2024-04-15T23:31:31.881242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869567+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:32.869567+0000","last_peered":"2024-04-15T23:31:32.869567+0000","last_clean":"2024-04-15T23:31:32.869567+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:32.869567+0000","last_undegraded":"2024-04-15T23:31:32.869567+0000","last_fullsized":"2024-04-15T23:31:32.869567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873279+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:32.873279+0000","last_peered":"2024-04-15T23:31:32.873279+0000","last_clean":"2024-04-15T23:31:32.873279+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:32.873279+0000","last_undegraded":"2024-04-15T23:31:32.873279+0000","last_fullsized":"2024-04-15T23:31:32.873279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873547+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:32.873547+0000","last_peered":"2024-04-15T23:31:32.873547+0000","last_clean":"2024-04-15T23:31:32.873547+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:32.873547+0000","last_undegraded":"2024-04-15T23:31:32.873547+0000","last_fullsized":"2024-04-15T23:31:32.873547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869117+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:32.869117+0000","last_peered":"2024-04-15T23:31:32.869117+0000","last_clean":"2024-04-15T23:31:32.869117+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:32.869117+0000","last_undegraded":"2024-04-15T23:31:32.869117+0000","last_fullsized":"2024-04-15T23:31:32.869117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873596+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:32.873596+0000","last_peered":"2024-04-15T23:31:32.873596+0000","last_clean":"2024-04-15T23:31:32.873596+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:32.873596+0000","last_undegraded":"2024-04-15T23:31:32.873596+0000","last_fullsized":"2024-04-15T23:31:32.873596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869211+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:32.869211+0000","last_peered":"2024-04-15T23:31:32.869211+0000","last_clean":"2024-04-15T23:31:32.869211+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:32.869211+0000","last_undegraded":"2024-04-15T23:31:32.869211+0000","last_fullsized":"2024-04-15T23:31:32.869211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881418+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:31.881418+0000","last_peered":"2024-04-15T23:31:31.881418+0000","last_clean":"2024-04-15T23:31:31.881418+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:31.881418+0000","last_undegraded":"2024-04-15T23:31:31.881418+0000","last_fullsized":"2024-04-15T23:31:31.881418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869239+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:32.869239+0000","last_peered":"2024-04-15T23:31:32.869239+0000","last_clean":"2024-04-15T23:31:32.869239+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:32.869239+0000","last_undegraded":"2024-04-15T23:31:32.869239+0000","last_fullsized":"2024-04-15T23:31:32.869239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882374+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:31.882374+0000","last_peered":"2024-04-15T23:31:31.882374+0000","last_clean":"2024-04-15T23:31:31.882374+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:31.882374+0000","last_undegraded":"2024-04-15T23:31:31.882374+0000","last_fullsized":"2024-04-15T23:31:31.882374+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881543+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:31.881543+0000","last_peered":"2024-04-15T23:31:31.881543+0000","last_clean":"2024-04-15T23:31:31.881543+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:31.881543+0000","last_undegraded":"2024-04-15T23:31:31.881543+0000","last_fullsized":"2024-04-15T23:31:31.881543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869884+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:32.869884+0000","last_peered":"2024-04-15T23:31:32.869884+0000","last_clean":"2024-04-15T23:31:32.869884+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:32.869884+0000","last_undegraded":"2024-04-15T23:31:32.869884+0000","last_fullsized":"2024-04-15T23:31:32.869884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869595+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:32.869595+0000","last_peered":"2024-04-15T23:31:32.869595+0000","last_clean":"2024-04-15T23:31:32.869595+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:32.869595+0000","last_undegraded":"2024-04-15T23:31:32.869595+0000","last_fullsized":"2024-04-15T23:31:32.869595+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868519+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:32.868519+0000","last_peered":"2024-04-15T23:31:32.868519+0000","last_clean":"2024-04-15T23:31:32.868519+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:32.868519+0000","last_undegraded":"2024-04-15T23:31:32.868519+0000","last_fullsized":"2024-04-15T23:31:32.868519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.871245+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:32.871245+0000","last_peered":"2024-04-15T23:31:32.871245+0000","last_clean":"2024-04-15T23:31:32.871245+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:32.871245+0000","last_undegraded":"2024-04-15T23:31:32.871245+0000","last_fullsized":"2024-04-15T23:31:32.871245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873285+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:32.873285+0000","last_peered":"2024-04-15T23:31:32.873285+0000","last_clean":"2024-04-15T23:31:32.873285+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:32.873285+0000","last_undegraded":"2024-04-15T23:31:32.873285+0000","last_fullsized":"2024-04-15T23:31:32.873285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881196+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:31.881196+0000","last_peered":"2024-04-15T23:31:31.881196+0000","last_clean":"2024-04-15T23:31:31.881196+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:31.881196+0000","last_undegraded":"2024-04-15T23:31:31.881196+0000","last_fullsized":"2024-04-15T23:31:31.881196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873078+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:32.873078+0000","last_peered":"2024-04-15T23:31:32.873078+0000","last_clean":"2024-04-15T23:31:32.873078+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:32.873078+0000","last_undegraded":"2024-04-15T23:31:32.873078+0000","last_fullsized":"2024-04-15T23:31:32.873078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873349+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:32.873349+0000","last_peered":"2024-04-15T23:31:32.873349+0000","last_clean":"2024-04-15T23:31:32.873349+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:32.873349+0000","last_undegraded":"2024-04-15T23:31:32.873349+0000","last_fullsized":"2024-04-15T23:31:32.873349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868520+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:32.868520+0000","last_peered":"2024-04-15T23:31:32.868520+0000","last_clean":"2024-04-15T23:31:32.868520+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:32.868520+0000","last_undegraded":"2024-04-15T23:31:32.868520+0000","last_fullsized":"2024-04-15T23:31:32.868520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882316+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:31.882316+0000","last_peered":"2024-04-15T23:31:31.882316+0000","last_clean":"2024-04-15T23:31:31.882316+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:31.882316+0000","last_undegraded":"2024-04-15T23:31:31.882316+0000","last_fullsized":"2024-04-15T23:31:31.882316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873151+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:32.873151+0000","last_peered":"2024-04-15T23:31:32.873151+0000","last_clean":"2024-04-15T23:31:32.873151+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:32.873151+0000","last_undegraded":"2024-04-15T23:31:32.873151+0000","last_fullsized":"2024-04-15T23:31:32.873151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868637+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:32.868637+0000","last_peered":"2024-04-15T23:31:32.868637+0000","last_clean":"2024-04-15T23:31:32.868637+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:32.868637+0000","last_undegraded":"2024-04-15T23:31:32.868637+0000","last_fullsized":"2024-04-15T23:31:32.868637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869780+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:32.869780+0000","last_peered":"2024-04-15T23:31:32.869780+0000","last_clean":"2024-04-15T23:31:32.869780+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:32.869780+0000","last_undegraded":"2024-04-15T23:31:32.869780+0000","last_fullsized":"2024-04-15T23:31:32.869780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868441+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:32.868441+0000","last_peered":"2024-04-15T23:31:32.868441+0000","last_clean":"2024-04-15T23:31:32.868441+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:32.868441+0000","last_undegraded":"2024-04-15T23:31:32.868441+0000","last_fullsized":"2024-04-15T23:31:32.868441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882405+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:31.882405+0000","last_peered":"2024-04-15T23:31:31.882405+0000","last_clean":"2024-04-15T23:31:31.882405+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:31.882405+0000","last_undegraded":"2024-04-15T23:31:31.882405+0000","last_fullsized":"2024-04-15T23:31:31.882405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868560+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:32.868560+0000","last_peered":"2024-04-15T23:31:32.868560+0000","last_clean":"2024-04-15T23:31:32.868560+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:32.868560+0000","last_undegraded":"2024-04-15T23:31:32.868560+0000","last_fullsized":"2024-04-15T23:31:32.868560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869302+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:32.869302+0000","last_peered":"2024-04-15T23:31:32.869302+0000","last_clean":"2024-04-15T23:31:32.869302+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:32.869302+0000","last_undegraded":"2024-04-15T23:31:32.869302+0000","last_fullsized":"2024-04-15T23:31:32.869302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868627+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:32.868627+0000","last_peered":"2024-04-15T23:31:32.868627+0000","last_clean":"2024-04-15T23:31:32.868627+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:32.868627+0000","last_undegraded":"2024-04-15T23:31:32.868627+0000","last_fullsized":"2024-04-15T23:31:32.868627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882022+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:31.882022+0000","last_peered":"2024-04-15T23:31:31.882022+0000","last_clean":"2024-04-15T23:31:31.882022+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:31.882022+0000","last_undegraded":"2024-04-15T23:31:31.882022+0000","last_fullsized":"2024-04-15T23:31:31.882022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881588+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:31.881588+0000","last_peered":"2024-04-15T23:31:31.881588+0000","last_clean":"2024-04-15T23:31:31.881588+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:31.881588+0000","last_undegraded":"2024-04-15T23:31:31.881588+0000","last_fullsized":"2024-04-15T23:31:31.881588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881564+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:31.881564+0000","last_peered":"2024-04-15T23:31:31.881564+0000","last_clean":"2024-04-15T23:31:31.881564+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:31.881564+0000","last_undegraded":"2024-04-15T23:31:31.881564+0000","last_fullsized":"2024-04-15T23:31:31.881564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881687+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:31.881687+0000","last_peered":"2024-04-15T23:31:31.881687+0000","last_clean":"2024-04-15T23:31:31.881687+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:31.881687+0000","last_undegraded":"2024-04-15T23:31:31.881687+0000","last_fullsized":"2024-04-15T23:31:31.881687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873275+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:32.873275+0000","last_peered":"2024-04-15T23:31:32.873275+0000","last_clean":"2024-04-15T23:31:32.873275+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:32.873275+0000","last_undegraded":"2024-04-15T23:31:32.873275+0000","last_fullsized":"2024-04-15T23:31:32.873275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873266+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:32.873266+0000","last_peered":"2024-04-15T23:31:32.873266+0000","last_clean":"2024-04-15T23:31:32.873266+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:32.873266+0000","last_undegraded":"2024-04-15T23:31:32.873266+0000","last_fullsized":"2024-04-15T23:31:32.873266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873207+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:32.873207+0000","last_peered":"2024-04-15T23:31:32.873207+0000","last_clean":"2024-04-15T23:31:32.873207+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:32.873207+0000","last_undegraded":"2024-04-15T23:31:32.873207+0000","last_fullsized":"2024-04-15T23:31:32.873207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882153+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:31.882153+0000","last_peered":"2024-04-15T23:31:31.882153+0000","last_clean":"2024-04-15T23:31:31.882153+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:31.882153+0000","last_undegraded":"2024-04-15T23:31:31.882153+0000","last_fullsized":"2024-04-15T23:31:31.882153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881611+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:31.881611+0000","last_peered":"2024-04-15T23:31:31.881611+0000","last_clean":"2024-04-15T23:31:31.881611+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:31.881611+0000","last_undegraded":"2024-04-15T23:31:31.881611+0000","last_fullsized":"2024-04-15T23:31:31.881611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869520+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:32.869520+0000","last_peered":"2024-04-15T23:31:32.869520+0000","last_clean":"2024-04-15T23:31:32.869520+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:32.869520+0000","last_undegraded":"2024-04-15T23:31:32.869520+0000","last_fullsized":"2024-04-15T23:31:32.869520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873123+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:32.873123+0000","last_peered":"2024-04-15T23:31:32.873123+0000","last_clean":"2024-04-15T23:31:32.873123+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:32.873123+0000","last_undegraded":"2024-04-15T23:31:32.873123+0000","last_fullsized":"2024-04-15T23:31:32.873123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869698+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:32.869698+0000","last_peered":"2024-04-15T23:31:32.869698+0000","last_clean":"2024-04-15T23:31:32.869698+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:32.869698+0000","last_undegraded":"2024-04-15T23:31:32.869698+0000","last_fullsized":"2024-04-15T23:31:32.869698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:47.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:48.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:48.069 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:48.078 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-15T23:31:47.771505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002512"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882232+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:31.882232+0000","last_peered":"2024-04-15T23:31:31.882232+0000","last_clean":"2024-04-15T23:31:31.882232+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:31.882232+0000","last_undegraded":"2024-04-15T23:31:31.882232+0000","last_fullsized":"2024-04-15T23:31:31.882232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881959+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:31.881959+0000","last_peered":"2024-04-15T23:31:31.881959+0000","last_clean":"2024-04-15T23:31:31.881959+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:31.881959+0000","last_undegraded":"2024-04-15T23:31:31.881959+0000","last_fullsized":"2024-04-15T23:31:31.881959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873116+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:32.873116+0000","last_peered":"2024-04-15T23:31:32.873116+0000","last_clean":"2024-04-15T23:31:32.873116+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:32.873116+0000","last_undegraded":"2024-04-15T23:31:32.873116+0000","last_fullsized":"2024-04-15T23:31:32.873116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872895+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:32.872895+0000","last_peered":"2024-04-15T23:31:32.872895+0000","last_clean":"2024-04-15T23:31:32.872895+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:32.872895+0000","last_undegraded":"2024-04-15T23:31:32.872895+0000","last_fullsized":"2024-04-15T23:31:32.872895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881576+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:31.881576+0000","last_peered":"2024-04-15T23:31:31.881576+0000","last_clean":"2024-04-15T23:31:31.881576+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:31.881576+0000","last_undegraded":"2024-04-15T23:31:31.881576+0000","last_fullsized":"2024-04-15T23:31:31.881576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872413+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:32.872413+0000","last_peered":"2024-04-15T23:31:32.872413+0000","last_clean":"2024-04-15T23:31:32.872413+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:32.872413+0000","last_undegraded":"2024-04-15T23:31:32.872413+0000","last_fullsized":"2024-04-15T23:31:32.872413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872547+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:32.872547+0000","last_peered":"2024-04-15T23:31:32.872547+0000","last_clean":"2024-04-15T23:31:32.872547+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:32.872547+0000","last_undegraded":"2024-04-15T23:31:32.872547+0000","last_fullsized":"2024-04-15T23:31:32.872547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872247+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:32.872247+0000","last_peered":"2024-04-15T23:31:32.872247+0000","last_clean":"2024-04-15T23:31:32.872247+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:32.872247+0000","last_undegraded":"2024-04-15T23:31:32.872247+0000","last_fullsized":"2024-04-15T23:31:32.872247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869374+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:32.869374+0000","last_peered":"2024-04-15T23:31:32.869374+0000","last_clean":"2024-04-15T23:31:32.869374+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:32.869374+0000","last_undegraded":"2024-04-15T23:31:32.869374+0000","last_fullsized":"2024-04-15T23:31:32.869374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881987+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:31.881987+0000","last_peered":"2024-04-15T23:31:31.881987+0000","last_clean":"2024-04-15T23:31:31.881987+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:31.881987+0000","last_undegraded":"2024-04-15T23:31:31.881987+0000","last_fullsized":"2024-04-15T23:31:31.881987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873095+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:32.873095+0000","last_peered":"2024-04-15T23:31:32.873095+0000","last_clean":"2024-04-15T23:31:32.873095+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:32.873095+0000","last_undegraded":"2024-04-15T23:31:32.873095+0000","last_fullsized":"2024-04-15T23:31:32.873095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881697+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:31.881697+0000","last_peered":"2024-04-15T23:31:31.881697+0000","last_clean":"2024-04-15T23:31:31.881697+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:31.881697+0000","last_undegraded":"2024-04-15T23:31:31.881697+0000","last_fullsized":"2024-04-15T23:31:31.881697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881360+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:31.881360+0000","last_peered":"2024-04-15T23:31:31.881360+0000","last_clean":"2024-04-15T23:31:31.881360+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:31.881360+0000","last_undegraded":"2024-04-15T23:31:31.881360+0000","last_fullsized":"2024-04-15T23:31:31.881360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872570+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:32.872570+0000","last_peered":"2024-04-15T23:31:32.872570+0000","last_clean":"2024-04-15T23:31:32.872570+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:32.872570+0000","last_undegraded":"2024-04-15T23:31:32.872570+0000","last_fullsized":"2024-04-15T23:31:32.872570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872656+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:32.872656+0000","last_peered":"2024-04-15T23:31:32.872656+0000","last_clean":"2024-04-15T23:31:32.872656+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:32.872656+0000","last_undegraded":"2024-04-15T23:31:32.872656+0000","last_fullsized":"2024-04-15T23:31:32.872656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872467+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:32.872467+0000","last_peered":"2024-04-15T23:31:32.872467+0000","last_clean":"2024-04-15T23:31:32.872467+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:32.872467+0000","last_undegraded":"2024-04-15T23:31:32.872467+0000","last_fullsized":"2024-04-15T23:31:32.872467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869858+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:32.869858+0000","last_peered":"2024-04-15T23:31:32.869858+0000","last_clean":"2024-04-15T23:31:32.869858+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:32.869858+0000","last_undegraded":"2024-04-15T23:31:32.869858+0000","last_fullsized":"2024-04-15T23:31:32.869858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882220+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:31.882220+0000","last_peered":"2024-04-15T23:31:31.882220+0000","last_clean":"2024-04-15T23:31:31.882220+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:31.882220+0000","last_undegraded":"2024-04-15T23:31:31.882220+0000","last_fullsized":"2024-04-15T23:31:31.882220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869019+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:32.869019+0000","last_peered":"2024-04-15T23:31:32.869019+0000","last_clean":"2024-04-15T23:31:32.869019+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:32.869019+0000","last_undegraded":"2024-04-15T23:31:32.869019+0000","last_fullsized":"2024-04-15T23:31:32.869019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873131+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:32.873131+0000","last_peered":"2024-04-15T23:31:32.873131+0000","last_clean":"2024-04-15T23:31:32.873131+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:32.873131+0000","last_undegraded":"2024-04-15T23:31:32.873131+0000","last_fullsized":"2024-04-15T23:31:32.873131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873464+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:32.873464+0000","last_peered":"2024-04-15T23:31:32.873464+0000","last_clean":"2024-04-15T23:31:32.873464+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:32.873464+0000","last_undegraded":"2024-04-15T23:31:32.873464+0000","last_fullsized":"2024-04-15T23:31:32.873464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881386+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:31.881386+0000","last_peered":"2024-04-15T23:31:31.881386+0000","last_clean":"2024-04-15T23:31:31.881386+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:31.881386+0000","last_undegraded":"2024-04-15T23:31:31.881386+0000","last_fullsized":"2024-04-15T23:31:31.881386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868278+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:32.868278+0000","last_peered":"2024-04-15T23:31:32.868278+0000","last_clean":"2024-04-15T23:31:32.868278+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:32.868278+0000","last_undegraded":"2024-04-15T23:31:32.868278+0000","last_fullsized":"2024-04-15T23:31:32.868278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.880945+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:31.880945+0000","last_peered":"2024-04-15T23:31:31.880945+0000","last_clean":"2024-04-15T23:31:31.880945+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:31.880945+0000","last_undegraded":"2024-04-15T23:31:31.880945+0000","last_fullsized":"2024-04-15T23:31:31.880945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882304+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:31.882304+0000","last_peered":"2024-04-15T23:31:31.882304+0000","last_clean":"2024-04-15T23:31:31.882304+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:31.882304+0000","last_undegraded":"2024-04-15T23:31:31.882304+0000","last_fullsized":"2024-04-15T23:31:31.882304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869414+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869414+0000","last_peered":"2024-04-15T23:31:32.869414+0000","last_clean":"2024-04-15T23:31:32.869414+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:32.869414+0000","last_undegraded":"2024-04-15T23:31:32.869414+0000","last_fullsized":"2024-04-15T23:31:32.869414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873492+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:32.873492+0000","last_peered":"2024-04-15T23:31:32.873492+0000","last_clean":"2024-04-15T23:31:32.873492+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:32.873492+0000","last_undegraded":"2024-04-15T23:31:32.873492+0000","last_fullsized":"2024-04-15T23:31:32.873492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881984+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:31.881984+0000","last_peered":"2024-04-15T23:31:31.881984+0000","last_clean":"2024-04-15T23:31:31.881984+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:31.881984+0000","last_undegraded":"2024-04-15T23:31:31.881984+0000","last_fullsized":"2024-04-15T23:31:31.881984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869197+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:32.869197+0000","last_peered":"2024-04-15T23:31:32.869197+0000","last_clean":"2024-04-15T23:31:32.869197+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:32.869197+0000","last_undegraded":"2024-04-15T23:31:32.869197+0000","last_fullsized":"2024-04-15T23:31:32.869197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881682+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:31.881682+0000","last_peered":"2024-04-15T23:31:31.881682+0000","last_clean":"2024-04-15T23:31:31.881682+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:31.881682+0000","last_undegraded":"2024-04-15T23:31:31.881682+0000","last_fullsized":"2024-04-15T23:31:31.881682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868338+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:32.868338+0000","last_peered":"2024-04-15T23:31:32.868338+0000","last_clean":"2024-04-15T23:31:32.868338+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:32.868338+0000","last_undegraded":"2024-04-15T23:31:32.868338+0000","last_fullsized":"2024-04-15T23:31:32.868338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872437+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:32.872437+0000","last_peered":"2024-04-15T23:31:32.872437+0000","last_clean":"2024-04-15T23:31:32.872437+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:32.872437+0000","last_undegraded":"2024-04-15T23:31:32.872437+0000","last_fullsized":"2024-04-15T23:31:32.872437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881756+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:31.881756+0000","last_peered":"2024-04-15T23:31:31.881756+0000","last_clean":"2024-04-15T23:31:31.881756+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:31.881756+0000","last_undegraded":"2024-04-15T23:31:31.881756+0000","last_fullsized":"2024-04-15T23:31:31.881756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873498+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:32.873498+0000","last_peered":"2024-04-15T23:31:32.873498+0000","last_clean":"2024-04-15T23:31:32.873498+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:32.873498+0000","last_undegraded":"2024-04-15T23:31:32.873498+0000","last_fullsized":"2024-04-15T23:31:32.873498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882157+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:31.882157+0000","last_peered":"2024-04-15T23:31:31.882157+0000","last_clean":"2024-04-15T23:31:31.882157+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:31.882157+0000","last_undegraded":"2024-04-15T23:31:31.882157+0000","last_fullsized":"2024-04-15T23:31:31.882157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868654+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:32.868654+0000","last_peered":"2024-04-15T23:31:32.868654+0000","last_clean":"2024-04-15T23:31:32.868654+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:32.868654+0000","last_undegraded":"2024-04-15T23:31:32.868654+0000","last_fullsized":"2024-04-15T23:31:32.868654+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869537+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869537+0000","last_peered":"2024-04-15T23:31:32.869537+0000","last_clean":"2024-04-15T23:31:32.869537+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:32.869537+0000","last_undegraded":"2024-04-15T23:31:32.869537+0000","last_fullsized":"2024-04-15T23:31:32.869537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881346+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:31.881346+0000","last_peered":"2024-04-15T23:31:31.881346+0000","last_clean":"2024-04-15T23:31:31.881346+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:31.881346+0000","last_undegraded":"2024-04-15T23:31:31.881346+0000","last_fullsized":"2024-04-15T23:31:31.881346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869351+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:32.869351+0000","last_peered":"2024-04-15T23:31:32.869351+0000","last_clean":"2024-04-15T23:31:32.869351+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:32.869351+0000","last_undegraded":"2024-04-15T23:31:32.869351+0000","last_fullsized":"2024-04-15T23:31:32.869351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872629+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:32.872629+0000","last_peered":"2024-04-15T23:31:32.872629+0000","last_clean":"2024-04-15T23:31:32.872629+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:32.872629+0000","last_undegraded":"2024-04-15T23:31:32.872629+0000","last_fullsized":"2024-04-15T23:31:32.872629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873206+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:32.873206+0000","last_peered":"2024-04-15T23:31:32.873206+0000","last_clean":"2024-04-15T23:31:32.873206+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:32.873206+0000","last_undegraded":"2024-04-15T23:31:32.873206+0000","last_fullsized":"2024-04-15T23:31:32.873206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881005+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:31.881005+0000","last_peered":"2024-04-15T23:31:31.881005+0000","last_clean":"2024-04-15T23:31:31.881005+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:31.881005+0000","last_undegraded":"2024-04-15T23:31:31.881005+0000","last_fullsized":"2024-04-15T23:31:31.881005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882332+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:31.882332+0000","last_peered":"2024-04-15T23:31:31.882332+0000","last_clean":"2024-04-15T23:31:31.882332+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:31.882332+0000","last_undegraded":"2024-04-15T23:31:31.882332+0000","last_fullsized":"2024-04-15T23:31:31.882332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881199+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:31.881199+0000","last_peered":"2024-04-15T23:31:31.881199+0000","last_clean":"2024-04-15T23:31:31.881199+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:31.881199+0000","last_undegraded":"2024-04-15T23:31:31.881199+0000","last_fullsized":"2024-04-15T23:31:31.881199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873620+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:32.873620+0000","last_peered":"2024-04-15T23:31:32.873620+0000","last_clean":"2024-04-15T23:31:32.873620+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:32.873620+0000","last_undegraded":"2024-04-15T23:31:32.873620+0000","last_fullsized":"2024-04-15T23:31:32.873620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872743+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:32.872743+0000","last_peered":"2024-04-15T23:31:32.872743+0000","last_clean":"2024-04-15T23:31:32.872743+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:32.872743+0000","last_undegraded":"2024-04-15T23:31:32.872743+0000","last_fullsized":"2024-04-15T23:31:32.872743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873389+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:32.873389+0000","last_peered":"2024-04-15T23:31:32.873389+0000","last_clean":"2024-04-15T23:31:32.873389+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:32.873389+0000","last_undegraded":"2024-04-15T23:31:32.873389+0000","last_fullsized":"2024-04-15T23:31:32.873389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868888+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:32.868888+0000","last_peered":"2024-04-15T23:31:32.868888+0000","last_clean":"2024-04-15T23:31:32.868888+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:32.868888+0000","last_undegraded":"2024-04-15T23:31:32.868888+0000","last_fullsized":"2024-04-15T23:31:32.868888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869420+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:32.869420+0000","last_peered":"2024-04-15T23:31:32.869420+0000","last_clean":"2024-04-15T23:31:32.869420+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:32.869420+0000","last_undegraded":"2024-04-15T23:31:32.869420+0000","last_fullsized":"2024-04-15T23:31:32.869420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873238+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:32.873238+0000","last_peered":"2024-04-15T23:31:32.873238+0000","last_clean":"2024-04-15T23:31:32.873238+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:32.873238+0000","last_undegraded":"2024-04-15T23:31:32.873238+0000","last_fullsized":"2024-04-15T23:31:32.873238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873205+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:32.873205+0000","last_peered":"2024-04-15T23:31:32.873205+0000","last_clean":"2024-04-15T23:31:32.873205+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:32.873205+0000","last_undegraded":"2024-04-15T23:31:32.873205+0000","last_fullsized":"2024-04-15T23:31:32.873205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873417+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:32.873417+0000","last_peered":"2024-04-15T23:31:32.873417+0000","last_clean":"2024-04-15T23:31:32.873417+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:32.873417+0000","last_undegraded":"2024-04-15T23:31:32.873417+0000","last_fullsized":"2024-04-15T23:31:32.873417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881379+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:31.881379+0000","last_peered":"2024-04-15T23:31:31.881379+0000","last_clean":"2024-04-15T23:31:31.881379+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:31.881379+0000","last_undegraded":"2024-04-15T23:31:31.881379+0000","last_fullsized":"2024-04-15T23:31:31.881379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873159+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:32.873159+0000","last_peered":"2024-04-15T23:31:32.873159+0000","last_clean":"2024-04-15T23:31:32.873159+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:32.873159+0000","last_undegraded":"2024-04-15T23:31:32.873159+0000","last_fullsized":"2024-04-15T23:31:32.873159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881106+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:31.881106+0000","last_peered":"2024-04-15T23:31:31.881106+0000","last_clean":"2024-04-15T23:31:31.881106+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:31.881106+0000","last_undegraded":"2024-04-15T23:31:31.881106+0000","last_fullsized":"2024-04-15T23:31:31.881106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869573+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:32.869573+0000","last_peered":"2024-04-15T23:31:32.869573+0000","last_clean":"2024-04-15T23:31:32.869573+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:32.869573+0000","last_undegraded":"2024-04-15T23:31:32.869573+0000","last_fullsized":"2024-04-15T23:31:32.869573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873127+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:32.873127+0000","last_peered":"2024-04-15T23:31:32.873127+0000","last_clean":"2024-04-15T23:31:32.873127+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:32.873127+0000","last_undegraded":"2024-04-15T23:31:32.873127+0000","last_fullsized":"2024-04-15T23:31:32.873127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873569+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:32.873569+0000","last_peered":"2024-04-15T23:31:32.873569+0000","last_clean":"2024-04-15T23:31:32.873569+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:32.873569+0000","last_undegraded":"2024-04-15T23:31:32.873569+0000","last_fullsized":"2024-04-15T23:31:32.873569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868860+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:32.868860+0000","last_peered":"2024-04-15T23:31:32.868860+0000","last_clean":"2024-04-15T23:31:32.868860+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:32.868860+0000","last_undegraded":"2024-04-15T23:31:32.868860+0000","last_fullsized":"2024-04-15T23:31:32.868860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873528+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:32.873528+0000","last_peered":"2024-04-15T23:31:32.873528+0000","last_clean":"2024-04-15T23:31:32.873528+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:32.873528+0000","last_undegraded":"2024-04-15T23:31:32.873528+0000","last_fullsized":"2024-04-15T23:31:32.873528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873011+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:32.873011+0000","last_peered":"2024-04-15T23:31:32.873011+0000","last_clean":"2024-04-15T23:31:32.873011+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:32.873011+0000","last_undegraded":"2024-04-15T23:31:32.873011+0000","last_fullsized":"2024-04-15T23:31:32.873011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868778+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:32.868778+0000","last_peered":"2024-04-15T23:31:32.868778+0000","last_clean":"2024-04-15T23:31:32.868778+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:32.868778+0000","last_undegraded":"2024-04-15T23:31:32.868778+0000","last_fullsized":"2024-04-15T23:31:32.868778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882190+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:31.882190+0000","last_peered":"2024-04-15T23:31:31.882190+0000","last_clean":"2024-04-15T23:31:31.882190+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:31.882190+0000","last_undegraded":"2024-04-15T23:31:31.882190+0000","last_fullsized":"2024-04-15T23:31:31.882190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868848+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:32.868848+0000","last_peered":"2024-04-15T23:31:32.868848+0000","last_clean":"2024-04-15T23:31:32.868848+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:32.868848+0000","last_undegraded":"2024-04-15T23:31:32.868848+0000","last_fullsized":"2024-04-15T23:31:32.868848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881242+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:31.881242+0000","last_peered":"2024-04-15T23:31:31.881242+0000","last_clean":"2024-04-15T23:31:31.881242+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:31.881242+0000","last_undegraded":"2024-04-15T23:31:31.881242+0000","last_fullsized":"2024-04-15T23:31:31.881242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869567+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:32.869567+0000","last_peered":"2024-04-15T23:31:32.869567+0000","last_clean":"2024-04-15T23:31:32.869567+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:32.869567+0000","last_undegraded":"2024-04-15T23:31:32.869567+0000","last_fullsized":"2024-04-15T23:31:32.869567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873279+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:32.873279+0000","last_peered":"2024-04-15T23:31:32.873279+0000","last_clean":"2024-04-15T23:31:32.873279+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:32.873279+0000","last_undegraded":"2024-04-15T23:31:32.873279+0000","last_fullsized":"2024-04-15T23:31:32.873279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873547+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:32.873547+0000","last_peered":"2024-04-15T23:31:32.873547+0000","last_clean":"2024-04-15T23:31:32.873547+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:32.873547+0000","last_undegraded":"2024-04-15T23:31:32.873547+0000","last_fullsized":"2024-04-15T23:31:32.873547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869117+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:32.869117+0000","last_peered":"2024-04-15T23:31:32.869117+0000","last_clean":"2024-04-15T23:31:32.869117+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:32.869117+0000","last_undegraded":"2024-04-15T23:31:32.869117+0000","last_fullsized":"2024-04-15T23:31:32.869117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873596+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:32.873596+0000","last_peered":"2024-04-15T23:31:32.873596+0000","last_clean":"2024-04-15T23:31:32.873596+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:32.873596+0000","last_undegraded":"2024-04-15T23:31:32.873596+0000","last_fullsized":"2024-04-15T23:31:32.873596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869211+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:32.869211+0000","last_peered":"2024-04-15T23:31:32.869211+0000","last_clean":"2024-04-15T23:31:32.869211+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:32.869211+0000","last_undegraded":"2024-04-15T23:31:32.869211+0000","last_fullsized":"2024-04-15T23:31:32.869211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881418+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:31.881418+0000","last_peered":"2024-04-15T23:31:31.881418+0000","last_clean":"2024-04-15T23:31:31.881418+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:31.881418+0000","last_undegraded":"2024-04-15T23:31:31.881418+0000","last_fullsized":"2024-04-15T23:31:31.881418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869239+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:32.869239+0000","last_peered":"2024-04-15T23:31:32.869239+0000","last_clean":"2024-04-15T23:31:32.869239+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:32.869239+0000","last_undegraded":"2024-04-15T23:31:32.869239+0000","last_fullsized":"2024-04-15T23:31:32.869239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882374+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:31.882374+0000","last_peered":"2024-04-15T23:31:31.882374+0000","last_clean":"2024-04-15T23:31:31.882374+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:31.882374+0000","last_undegraded":"2024-04-15T23:31:31.882374+0000","last_fullsized":"2024-04-15T23:31:31.882374+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881543+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:31.881543+0000","last_peered":"2024-04-15T23:31:31.881543+0000","last_clean":"2024-04-15T23:31:31.881543+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:31.881543+0000","last_undegraded":"2024-04-15T23:31:31.881543+0000","last_fullsized":"2024-04-15T23:31:31.881543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869884+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:32.869884+0000","last_peered":"2024-04-15T23:31:32.869884+0000","last_clean":"2024-04-15T23:31:32.869884+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:32.869884+0000","last_undegraded":"2024-04-15T23:31:32.869884+0000","last_fullsized":"2024-04-15T23:31:32.869884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869595+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:32.869595+0000","last_peered":"2024-04-15T23:31:32.869595+0000","last_clean":"2024-04-15T23:31:32.869595+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:32.869595+0000","last_undegraded":"2024-04-15T23:31:32.869595+0000","last_fullsized":"2024-04-15T23:31:32.869595+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868519+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:32.868519+0000","last_peered":"2024-04-15T23:31:32.868519+0000","last_clean":"2024-04-15T23:31:32.868519+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:32.868519+0000","last_undegraded":"2024-04-15T23:31:32.868519+0000","last_fullsized":"2024-04-15T23:31:32.868519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.871245+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:32.871245+0000","last_peered":"2024-04-15T23:31:32.871245+0000","last_clean":"2024-04-15T23:31:32.871245+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:32.871245+0000","last_undegraded":"2024-04-15T23:31:32.871245+0000","last_fullsized":"2024-04-15T23:31:32.871245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873285+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:32.873285+0000","last_peered":"2024-04-15T23:31:32.873285+0000","last_clean":"2024-04-15T23:31:32.873285+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:32.873285+0000","last_undegraded":"2024-04-15T23:31:32.873285+0000","last_fullsized":"2024-04-15T23:31:32.873285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881196+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:31.881196+0000","last_peered":"2024-04-15T23:31:31.881196+0000","last_clean":"2024-04-15T23:31:31.881196+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:31.881196+0000","last_undegraded":"2024-04-15T23:31:31.881196+0000","last_fullsized":"2024-04-15T23:31:31.881196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873078+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:32.873078+0000","last_peered":"2024-04-15T23:31:32.873078+0000","last_clean":"2024-04-15T23:31:32.873078+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:32.873078+0000","last_undegraded":"2024-04-15T23:31:32.873078+0000","last_fullsized":"2024-04-15T23:31:32.873078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873349+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:32.873349+0000","last_peered":"2024-04-15T23:31:32.873349+0000","last_clean":"2024-04-15T23:31:32.873349+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:32.873349+0000","last_undegraded":"2024-04-15T23:31:32.873349+0000","last_fullsized":"2024-04-15T23:31:32.873349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868520+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:32.868520+0000","last_peered":"2024-04-15T23:31:32.868520+0000","last_clean":"2024-04-15T23:31:32.868520+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:32.868520+0000","last_undegraded":"2024-04-15T23:31:32.868520+0000","last_fullsized":"2024-04-15T23:31:32.868520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882316+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:31.882316+0000","last_peered":"2024-04-15T23:31:31.882316+0000","last_clean":"2024-04-15T23:31:31.882316+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:31.882316+0000","last_undegraded":"2024-04-15T23:31:31.882316+0000","last_fullsized":"2024-04-15T23:31:31.882316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873151+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:32.873151+0000","last_peered":"2024-04-15T23:31:32.873151+0000","last_clean":"2024-04-15T23:31:32.873151+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:32.873151+0000","last_undegraded":"2024-04-15T23:31:32.873151+0000","last_fullsized":"2024-04-15T23:31:32.873151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868637+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:32.868637+0000","last_peered":"2024-04-15T23:31:32.868637+0000","last_clean":"2024-04-15T23:31:32.868637+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:32.868637+0000","last_undegraded":"2024-04-15T23:31:32.868637+0000","last_fullsized":"2024-04-15T23:31:32.868637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869780+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:32.869780+0000","last_peered":"2024-04-15T23:31:32.869780+0000","last_clean":"2024-04-15T23:31:32.869780+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:32.869780+0000","last_undegraded":"2024-04-15T23:31:32.869780+0000","last_fullsized":"2024-04-15T23:31:32.869780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868441+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:32.868441+0000","last_peered":"2024-04-15T23:31:32.868441+0000","last_clean":"2024-04-15T23:31:32.868441+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:32.868441+0000","last_undegraded":"2024-04-15T23:31:32.868441+0000","last_fullsized":"2024-04-15T23:31:32.868441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882405+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:31.882405+0000","last_peered":"2024-04-15T23:31:31.882405+0000","last_clean":"2024-04-15T23:31:31.882405+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:31.882405+0000","last_undegraded":"2024-04-15T23:31:31.882405+0000","last_fullsized":"2024-04-15T23:31:31.882405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868560+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:32.868560+0000","last_peered":"2024-04-15T23:31:32.868560+0000","last_clean":"2024-04-15T23:31:32.868560+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:32.868560+0000","last_undegraded":"2024-04-15T23:31:32.868560+0000","last_fullsized":"2024-04-15T23:31:32.868560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869302+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:32.869302+0000","last_peered":"2024-04-15T23:31:32.869302+0000","last_clean":"2024-04-15T23:31:32.869302+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:32.869302+0000","last_undegraded":"2024-04-15T23:31:32.869302+0000","last_fullsized":"2024-04-15T23:31:32.869302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868627+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:32.868627+0000","last_peered":"2024-04-15T23:31:32.868627+0000","last_clean":"2024-04-15T23:31:32.868627+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:32.868627+0000","last_undegraded":"2024-04-15T23:31:32.868627+0000","last_fullsized":"2024-04-15T23:31:32.868627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882022+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:31.882022+0000","last_peered":"2024-04-15T23:31:31.882022+0000","last_clean":"2024-04-15T23:31:31.882022+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:31.882022+0000","last_undegraded":"2024-04-15T23:31:31.882022+0000","last_fullsized":"2024-04-15T23:31:31.882022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881588+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:31.881588+0000","last_peered":"2024-04-15T23:31:31.881588+0000","last_clean":"2024-04-15T23:31:31.881588+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:31.881588+0000","last_undegraded":"2024-04-15T23:31:31.881588+0000","last_fullsized":"2024-04-15T23:31:31.881588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881564+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:31.881564+0000","last_peered":"2024-04-15T23:31:31.881564+0000","last_clean":"2024-04-15T23:31:31.881564+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:31.881564+0000","last_undegraded":"2024-04-15T23:31:31.881564+0000","last_fullsized":"2024-04-15T23:31:31.881564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881687+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:31.881687+0000","last_peered":"2024-04-15T23:31:31.881687+0000","last_clean":"2024-04-15T23:31:31.881687+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:31.881687+0000","last_undegraded":"2024-04-15T23:31:31.881687+0000","last_fullsized":"2024-04-15T23:31:31.881687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873275+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:32.873275+0000","last_peered":"2024-04-15T23:31:32.873275+0000","last_clean":"2024-04-15T23:31:32.873275+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:32.873275+0000","last_undegraded":"2024-04-15T23:31:32.873275+0000","last_fullsized":"2024-04-15T23:31:32.873275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873266+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:32.873266+0000","last_peered":"2024-04-15T23:31:32.873266+0000","last_clean":"2024-04-15T23:31:32.873266+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:32.873266+0000","last_undegraded":"2024-04-15T23:31:32.873266+0000","last_fullsized":"2024-04-15T23:31:32.873266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873207+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:32.873207+0000","last_peered":"2024-04-15T23:31:32.873207+0000","last_clean":"2024-04-15T23:31:32.873207+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:32.873207+0000","last_undegraded":"2024-04-15T23:31:32.873207+0000","last_fullsized":"2024-04-15T23:31:32.873207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882153+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:31.882153+0000","last_peered":"2024-04-15T23:31:31.882153+0000","last_clean":"2024-04-15T23:31:31.882153+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:31.882153+0000","last_undegraded":"2024-04-15T23:31:31.882153+0000","last_fullsized":"2024-04-15T23:31:31.882153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881611+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:31.881611+0000","last_peered":"2024-04-15T23:31:31.881611+0000","last_clean":"2024-04-15T23:31:31.881611+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:31.881611+0000","last_undegraded":"2024-04-15T23:31:31.881611+0000","last_fullsized":"2024-04-15T23:31:31.881611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869520+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:32.869520+0000","last_peered":"2024-04-15T23:31:32.869520+0000","last_clean":"2024-04-15T23:31:32.869520+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:32.869520+0000","last_undegraded":"2024-04-15T23:31:32.869520+0000","last_fullsized":"2024-04-15T23:31:32.869520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873123+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:32.873123+0000","last_peered":"2024-04-15T23:31:32.873123+0000","last_clean":"2024-04-15T23:31:32.873123+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:32.873123+0000","last_undegraded":"2024-04-15T23:31:32.873123+0000","last_fullsized":"2024-04-15T23:31:32.873123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869698+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:32.869698+0000","last_peered":"2024-04-15T23:31:32.869698+0000","last_clean":"2024-04-15T23:31:32.869698+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:32.869698+0000","last_undegraded":"2024-04-15T23:31:32.869698+0000","last_fullsized":"2024-04-15T23:31:32.869698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:48.083 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T23:31:48.083 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 15 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 60f632e8-f087-41df-a0b6-043b99131bd6 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-04-15T23:31:15.484738+0000 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:modified 2024-04-15T23:31:31.867515+0000 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:crush_version 4 2024-04-15T23:31:48.403 INFO:teuthology.orchestra.run.smithi102.stdout:full_ratio 0.95 2024-04-15T23:31:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:backfillfull_ratio 0.9 2024-04-15T23:31:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:nearfull_ratio 0.85 2024-04-15T23:31:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:require_min_compat_client luminous 2024-04-15T23:31:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:min_compat_client jewel 2024-04-15T23:31:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:require_osd_release squid 2024-04-15T23:31:48.404 INFO:teuthology.orchestra.run.smithi102.stdout:stretch_mode_enabled false 2024-04-15T23:31:48.405 INFO:teuthology.orchestra.run.smithi102.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-15T23:31:48.405 INFO:teuthology.orchestra.run.smithi102.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-15T23:31:48.405 INFO:teuthology.orchestra.run.smithi102.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-15T23:31:48.405 INFO:teuthology.orchestra.run.smithi102.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-15T23:31:48.405 INFO:teuthology.orchestra.run.smithi102.stdout:max_osd 3 2024-04-15T23:31:48.406 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/1269237815,v1:172.21.15.107:6801/1269237815] [v2:172.21.15.107:6802/1269237815,v1:172.21.15.107:6803/1269237815] exists,up 37ee61ed-86ab-4308-a161-cd2aafcfd4f9 2024-04-15T23:31:48.406 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/1544615186,v1:172.21.15.115:6801/1544615186] [v2:172.21.15.115:6802/1544615186,v1:172.21.15.115:6803/1544615186] exists,up 9631dded-d96a-40ad-945d-252291b498da 2024-04-15T23:31:48.406 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/2023242123,v1:172.21.15.195:6801/2023242123] [v2:172.21.15.195:6802/2023242123,v1:172.21.15.195:6803/2023242123] exists,up 45415c3c-3208-4cab-b6d2-75f250746bef 2024-04-15T23:31:48.416 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/1269237815,v1:172.21.15.107:6801/1269237815] [v2:172.21.15.107:6802/1269237815,v1:172.21.15.107:6803/1269237815] exists,up 37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'osd.1 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/1544615186,v1:172.21.15.115:6801/1544615186] [v2:172.21.15.115:6802/1544615186,v1:172.21.15.115:6803/1544615186] exists,up 9631dded-d96a-40ad-945d-252291b498da', 'osd.2 up in weight 1 up_from 8 up_thru 13 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/2023242123,v1:172.21.15.195:6801/2023242123] [v2:172.21.15.195:6802/2023242123,v1:172.21.15.195:6803/2023242123] exists,up 45415c3c-3208-4cab-b6d2-75f250746bef'] 2024-04-15T23:31:48.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-15T23:31:48.519 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:31:48.519 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mon.a", 2024-04-15T23:31:48.519 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster": "ceph", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "admin_socket_mode": "", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_client_required": "cephx, none", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_cluster_required": "cephx", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_debug": "true", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_service_required": "cephx", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "auth_supported": "cephx", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio": "true", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio_poll_ms": "250", 2024-04-15T23:31:48.520 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_aio_reap_max": "16", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_async_discard": "false", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_block_size": "4096", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_aio": "false", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_debug_inflight_ios": "false", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_enable_discard": "false", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_flock_retry": "3", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_inject_crash": "0", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_ioring": "false", 2024-04-15T23:31:48.521 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_ioring_hipri": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bdev_type": "", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_alloc_size": "1048576", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_allocator": "hybrid", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_buffered_io": "true", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_check_for_zeros": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_compact_log_sync": "false", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-15T23:31:48.522 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-15T23:31:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-15T23:31:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-15T23:31:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_max_log_runway": "4194304", 2024-04-15T23:31:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_max_prefetch": "1048576", 2024-04-15T23:31:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_min_flush_size": "524288", 2024-04-15T23:31:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_min_log_runway": "1048576", 2024-04-15T23:31:48.524 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_replay_recovery": "false", 2024-04-15T23:31:48.524 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-15T23:31:48.524 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-15T23:31:48.524 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_sync_write": "false", 2024-04-15T23:31:48.524 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-15T23:31:48.524 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_allocation_from_file": "true", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_allocator": "hybrid", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-15T23:31:48.525 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_create": "true", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_db_create": "false", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_db_path": "", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_db_size": "0", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_path": "", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_preallocate_file": "false", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_size": "107374182400", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_wal_create": "false", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_wal_path": "", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_block_wal_size": "100663296", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs": "true", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-15T23:31:48.526 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_autotune": "true", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_size": "0", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-15T23:31:48.527 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_type": "2q", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_clone_cow": "true", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_mode": "none", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_csum_type": "crc32c", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-15T23:31:48.528 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_freelist": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-15T23:31:48.529 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_small_allocations": "0", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_default_buffered_read": "true", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_default_buffered_write": "false", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fail_eio": "false", 2024-04-15T23:31:48.530 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mount": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_umount": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-15T23:31:48.531 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_ignore_data_csum": "false", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_log_op_age": "5.000000", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_alloc_size": "0", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_blob_size": "0", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_max_deferred_txc": "32", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_min_alloc_size": "0", 2024-04-15T23:31:48.532 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_nid_prealloc": "1024", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_retry_disk_reads": "3", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_cf": "true", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-15T23:31:48.533 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_spdk_mem": "512", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_tracing": "false", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-15T23:31:48.534 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_zero_block_detection": "false", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-15T23:31:48.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_cluster_require_signatures": "false", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_cluster_require_version": "2", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_require_signatures": "false", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_require_version": "2", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_service_require_signatures": "false", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_service_require_version": "2", 2024-04-15T23:31:48.536 INFO:teuthology.orchestra.run.smithi102.stdout: "cephx_sign_messages": "true", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "chdir": "", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_acl_type": "", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_asio_thread_count": "2", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_cache_mid": "0.750000", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_cache_size": "16384", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_caps_release_delay": "5", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_check_pool_perm": "true", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_force_sync_read": "false", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_getattr_caps": "false", 2024-04-15T23:31:48.537 INFO:teuthology.orchestra.run.smithi102.stdout: "client_debug_inject_tick_delay": "0", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_die_on_failed_remount": "false", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_dirsize_rbytes": "true", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_force_lazyio": "false", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_fs": "", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_inject_release_failure": "false", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_max_inline_size": "4096", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mds_namespace": "", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_metadata": "", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mount_gid": "-1", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mount_timeout": "300", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mount_uid": "-1", 2024-04-15T23:31:48.538 INFO:teuthology.orchestra.run.smithi102.stdout: "client_mountpoint": "/", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_notify_timeout": "10", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc": "true", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_max_dirty": "104857600", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_max_objects": "1000", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_size": "209715200", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_oc_target_dirty": "8388608", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_permissions": "true", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_quota": "true", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_quota_df": "true", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_readahead_max_bytes": "0", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_readahead_max_periods": "4", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_readahead_min": "131072", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_reconnect_stale": "false", 2024-04-15T23:31:48.539 INFO:teuthology.orchestra.run.smithi102.stdout: "client_shutdown_timeout": "30", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "client_snapdir": ".snap", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "client_tick_interval": "1", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "client_trace": "", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "client_try_dentry_invalidate": "false", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "client_use_faked_inos": "false", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "client_use_random_mds": "false", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_graylog": "false", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_graylog_port": "12201", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_monitors": "default=true", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_syslog": "false", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "clog_to_syslog_level": "info", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "-", 2024-04-15T23:31:48.540 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_network": "", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_network_interface": "", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zlib_isal": "false", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zlib_level": "5", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zlib_winsize": "-15", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "compressor_zstd_level": "1", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_alien_op_num_threads": "6", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crimson_seastar_cpu_cores": "", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_location": "", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_location_hook": "", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_location_hook_timeout": "10", 2024-04-15T23:31:48.541 INFO:teuthology.orchestra.run.smithi102.stdout: "daemonize": "false", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "daos_pool": "tank", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_alienstore": "0/5", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_allow_any_pool_priority": "false", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_asok": "1/5", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_asok_assert_abort": "false", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_asserts_on_shutdown": "true", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_auth": "20/20", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_bdev": "1/3", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_bluefs": "1/5", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_bluestore": "1/5", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_buffer": "0/1", 2024-04-15T23:31:48.542 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_ceph_exporter": "1/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_cephfs_mirror": "0/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_cephsqlite": "0/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_client": "0/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_compressor": "1/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_context": "0/1", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_crimson_interrupt": "0/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_crush": "1/1", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_crypto": "1/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_cyanstore": "0/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_deliberately_leak_memory": "false", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_disable_randomized_ping": "false", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_dpdk": "1/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_eventtrace": "1/5", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_filer": "0/1", 2024-04-15T23:31:48.543 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_filestore": "1/3", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_finisher": "1/1", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_fuse": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_heartbeat_testing_span": "0", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_heartbeatmap": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_javaclient": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_journal": "1/3", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_journaler": "0/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_kstore": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_lockdep": "0/1", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mclock": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_balancer": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_locker": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_log": "1/5", 2024-04-15T23:31:48.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_log_expire": "1/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_migrator": "1/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mds_quiesce": "3/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_memstore": "1/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mgr": "2/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mgrc": "1/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_mon": "20/20", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_monc": "0/10", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_ms": "1/1", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_none": "0/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_objclass": "0/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_objectcacher": "0/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_objecter": "0/1", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_optracker": "0/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_osd": "1/5", 2024-04-15T23:31:48.545 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_paxos": "20/20", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_perfcounter": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_prioritycache": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rados": "0/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd": "0/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd_mirror": "0/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd_pwl": "0/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rbd_replay": "0/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_refs": "0/0", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_reserver": "1/1", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_access": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_datacache": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_dbstore": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_flight": "1/5", 2024-04-15T23:31:48.546 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rgw_sync": "1/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_rocksdb": "4/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore": "0/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_backref": "0/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_cache": "0/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_cleaner": "0/5", 2024-04-15T23:31:48.547 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_device": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_epm": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_journal": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_lba": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_odata": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_omap": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_onode": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_t": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_seastore_tm": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_striper": "0/1", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_test": "0/5", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_throttle": "1/1", 2024-04-15T23:31:48.548 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_timer": "0/1", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_tp": "0/5", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "debug_trace": "1/5", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "device_failure_prediction_mode": "none", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_graylog": "false", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_journald": "false", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_stderr": "true", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "err_to_syslog": "false", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "event_tracing": "false", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_addr": "0.0.0.0", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_http_port": "9926", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_prio_limit": "5", 2024-04-15T23:31:48.549 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_sort_metrics": "true", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "exporter_stats_period": "5", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "fake_statfs_for_testing": "0", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "fatal_signal_handlers": "true", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filer_max_purge_ops": "10", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filer_max_truncate_ops": "128", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_apply_finisher_threads": "1", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_blackhole": "false", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_btrfs_clone_range": "true", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_btrfs_snap": "true", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_caller_concurrency": "10", 2024-04-15T23:31:48.550 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_collect_device_partition_information": "true", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_commit_timeout": "600.000000", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_inject_read_err": "false", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_omap_check": "false", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_debug_verify_split": "false", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_dump_file": "", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fadvise": "true", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fail_eio": "true", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fd_cache_shards": "16", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fd_cache_size": "128", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fiemap": "false", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fiemap_threshold": "4096", 2024-04-15T23:31:48.551 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_inject_stall": "0", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_journal_parallel": "false", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_journal_trailing": "false", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_journal_writeahead": "false", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_kill_at": "0", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs": "0", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-15T23:31:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size": "0", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_merge_threshold": "-10", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_odsync_write": "false", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_omap_backend": "rocksdb", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_omap_backend_path": "", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-15T23:31:48.553 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_op_thread_timeout": "60", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_op_threads": "2", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_punch_hole": "false", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_queue_max_ops": "50", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-15T23:31:48.554 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_seek_data_hole": "false", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_sloppy_crc": "false", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_splice": "false", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_split_multiple": "2", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_split_rand_factor": "20", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_update_to": "1000", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_enable": "true", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-15T23:31:48.555 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_xfs_extsize": "false", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "filestore_zfs_snap": "false", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fio_dir": "/tmp/fio", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_allow_other": "true", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_atomic_o_trunc": "true", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_big_writes": "true", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_debug": "false", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_default_permissions": "false", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_disable_pagecache": "false", 2024-04-15T23:31:48.556 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_max_write": "0", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_multithreaded": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_require_active_mds": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_set_user_groups": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_splice_move": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_splice_read": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_splice_write": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "fuse_use_invalidate_cb": "true", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "gss_target_name": "ceph", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_file": "", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_inject_failure": "0", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_interval": "5", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "host": "smithi102", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-15T23:31:48.557 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "inject_early_sigterm": "false", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "jaeger_agent_port": "6799", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "jaeger_tracing_enable": "false", 2024-04-15T23:31:48.558 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_aio": "true", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_align_min_size": "65536", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_block_align": "true", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_block_size": "4096", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_dio": "true", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_discard": "false", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_force_aio": "false", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_ignore_corruption": "false", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_max_write_bytes": "10485760", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_max_write_entries": "100", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_replay_from": "0", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-15T23:31:48.559 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_write_header_frequency": "0", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "journal_zero_on_create": "false", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "journaler_prefetch_periods": "10", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "journaler_prezero_periods": "5", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "journaler_write_head_interval": "15", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "key": "", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "keyfile": "", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_backend": "rocksdb", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_default_stripe_size": "65536", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_fsck_on_mount": "false", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_max_bytes": "67108864", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_max_ops": "512", 2024-04-15T23:31:48.560 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_nid_prealloc": "1024", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_onode_map_size": "1024", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_sync_submit_transaction": "false", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "kstore_sync_transaction": "false", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "librados_thread_count": "2", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "lockdep": "false", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "lockdep_force_backtrace": "false", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_coarse_timestamps": "true", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_flush_on_exit": "false", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_graylog_host": "127.0.0.1", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_graylog_port": "12201", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_max_new": "1000", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_max_recent": "10000", 2024-04-15T23:31:48.561 INFO:teuthology.orchestra.run.smithi102.stdout: "log_stderr_prefix": "", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_stop_at_utilization": "0.970000", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": "true", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_graylog": "false", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_journald": "false", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_stderr": "false", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_syslog": "false", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "max_rotating_auth_attempts": "10", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_action_on_write_error": "1", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_alternate_name_max": "8192", 2024-04-15T23:31:48.562 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_asio_thread_count": "2", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_export_pin": "true", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_dirs": "true", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_interval": "5", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_interval": "10", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_max": "-1", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_max_until": "-1", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_merge_size": "50", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_midchunk": "0.300000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_min_start": "0.200000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_minchunk": "0.001000", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_mode": "0", 2024-04-15T23:31:48.563 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_need_max": "1.200000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_need_min": "0.800000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_overload_epochs": "2", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_bits": "3", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_size": "10000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_target_decay": "10.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_beacon_grace": "15.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_beacon_interval": "4.000000", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-15T23:31:48.564 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_mid": "0.700000", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_delay": "0", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_release_free_interval": "10", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_reservation": "0.050000", 2024-04-15T23:31:48.565 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_trim_interval": "1", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache_trim_threshold": "262144", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_client_prealloc_inos": "1000", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-15T23:31:48.566 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_connect_bootstrapping": "false", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_damage_table_max_entries": "10000", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_auth_pins": "false", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_frag": "false", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_scatterstat": "false", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_debug_subtrees": "false", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_decay_halflife": "5.000000", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_default_dir_hash": "2", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_defer_session_stale": "true", 2024-04-15T23:31:48.567 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_deny_all_reconnect": "false", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_keys_per_op": "16384", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_max_commit_size": "10", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_max_entries": "0", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dir_prefetch": "true", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_on_map": "false", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_early_reply": "true", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_enable_op_tracker": "true", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_enforce_unique_name": "true", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-15T23:31:48.568 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_random": "true", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_health_summarize_threshold": "10", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_health_dummy": "false", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_migrator_session_race": "false", 2024-04-15T23:31:48.569 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_join_fs": "", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_journal_format": "1", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_create_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_export_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_import_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_journal_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_journal_expire_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_journal_replay_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_link_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_mdstable_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_openc_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_rename_at": "0", 2024-04-15T23:31:48.570 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_shutdown_at": "0", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_event_large_threshold": "524288", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_events_per_segment": "1024", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_max_events": "-1", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_max_segments": "128", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_pause": "false", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_segment_size": "0", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_trim_threshold": "128", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log_warn_factor": "2.000000", 2024-04-15T23:31:48.571 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_caps_per_client": "1048576", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_completed_flushes": "100000", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_completed_requests": "100000", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_export_size": "20971520", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_file_recover": "32", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_purge_files": "64", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_purge_ops": "8192", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_max_snaps_per_dir": "100", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_metrics_update_interval": "2", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_min_caps_per_client": "100", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_min_caps_working_set": "10000", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_numa_node": "-1", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-15T23:31:48.572 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_complaint_time": "30.000000", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_duration": "600", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_size": "20", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_slow_op_size": "20", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_op_log_threshold": "5", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_ping_grace": "15", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_ping_interval": "5", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_max_caps": "30000", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_recall_warning_threshold": "262144", 2024-04-15T23:31:48.573 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_replay_interval": "1.000000", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_root_ino_gid": "0", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_root_ino_uid": "0", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-15T23:31:48.574 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-15T23:31:48.575 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-15T23:31:48.575 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-15T23:31:48.575 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-15T23:31:48.575 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-15T23:31:48.575 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-15T23:31:48.575 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_shutdown_check": "0", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_skip_ino": "0", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_snap_max_uid": "4294967294", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_snap_min_uid": "0", 2024-04-15T23:31:48.576 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_snap_rstat": "false", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_standby_replay_damaged": "false", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_symlink_recovery": "true", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_thrash_exports": "0", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_thrash_fragments": "0", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_tick_interval": "5.000000", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_valgrind_exit": "false", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_verify_backtrace": "1", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_verify_scatter": "false", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-15T23:31:48.577 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_wipe_sessions": "false", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool_debug": "false", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_device_bytes": "1073741824", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_page_set": "false", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "memstore_page_size": "65536", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_client_bytes": "134217728", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_client_messages": "512", 2024-04-15T23:31:48.578 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_disabled_modules": "", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_max_pg_num_change": "128", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mds_bytes": "134217728", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mds_messages": "128", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-15T23:31:48.579 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mon_bytes": "134217728", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_mon_messages": "128", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_osd_bytes": "536870912", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_osd_messages": "8192", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_pool": "true", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_standby_modules": "true", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_stats_period": "5", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_stats_threshold": "5", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_tick_period": "2", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_allow_pool_delete": "true", 2024-04-15T23:31:48.580 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_allow_pool_size_one": "true", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_auth_validate_all_caps": "true", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_bytes": "104857600", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_directed_command_retry": "2", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-15T23:31:48.581 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_hunt_parallel": "3", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_log_interval": "1.000000", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_ping_interval": "10.000000", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_client_target_rank": "-1", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_file_level": "debug", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_file": "true", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-15T23:31:48.582 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_journald": "false", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_compact_on_bootstrap": "false", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_compact_on_start": "false", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_compact_on_trim": "true", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_cpu_threads": "4", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_crush_min_required_version": "hammer", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_daemon_bytes": "419430400", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-15T23:31:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data_avail_crit": "5", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data_avail_warn": "5", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_data_size_warn": "16106127360", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_dump_json": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_dump_transactions": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_extra_checks": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_require_reef": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_no_require_squid": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-15T23:31:48.584 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_down_mkfs_grace": "120", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_down_uptime_grace": "60", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_election_default_strategy": "1", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_election_timeout": "5.000000", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_elector_ping_divisor": "2", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_enable_op_tracker": "true", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_fake_pool_delete": "false", 2024-04-15T23:31:48.585 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_force_quorum_join": "false", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_globalid_prealloc": "10000", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_detail_to_clog": "false", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_log_update_period": "5", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_max_detail": "50", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_to_clog": "true", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_to_clog_interval": "600", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_host": "172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790],[v2:172.21.15.102:3302,v1:172.21.15.102:6791]", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_host_override": "", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_initial_members": "", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-15T23:31:48.586 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_lease": "5.000000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_log_full_interval": "50", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_log_max": "10000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_log_max_summary": "50", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_log_epochs": "500", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_osd": "10000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_pg_per_osd": "10000", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_pool_pg_num": "65536", 2024-04-15T23:31:48.587 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mds_force_trim_to": "0", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mds_skip_sanity": "false", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_memory_autotune": "true", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_memory_target": "2147483648", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_beacon_grace": "30", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_digest_period": "5", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_inactive_grace": "60", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-15T23:31:48.588 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-15T23:31:48.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_min_osdmap_epochs": "500", 2024-04-15T23:31:48.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_complaint_time": "30", 2024-04-15T23:31:48.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_duration": "600", 2024-04-15T23:31:48.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_size": "20", 2024-04-15T23:31:48.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_slow_op_size": "20", 2024-04-15T23:31:48.589 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-15T23:31:48.590 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_op_log_threshold": "5", 2024-04-15T23:31:48.590 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-15T23:31:48.590 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-15T23:31:48.590 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-15T23:31:48.590 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_auto_mark_in": "false", 2024-04-15T23:31:48.590 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_cache_size": "500", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_down_out_interval": "600", 2024-04-15T23:31:48.591 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_force_trim_to": "0", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-15T23:31:48.592 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_min_down_reporters": "2", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_report_timeout": "900", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-15T23:31:48.593 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_stuck_threshold": "60", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_probe_timeout": "2.000000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_max_change": "0.050000", 2024-04-15T23:31:48.594 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_max_osds": "4", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_interval": "86400", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_max_keys": "100", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_scrub_timeout": "300", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_session_timeout": "300", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_smart_report_timeout": "5", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stat_smooth_intervals": "6", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_pool_min_size": "2", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_pool_size": "4", 2024-04-15T23:31:48.595 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_debug": "false", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_provider_kill_at": "0", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_requester_kill_at": "0", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_sync_timeout": "60.000000", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_target_pg_per_osd": "100", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_tick_interval": "5", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_timecheck_interval": "300.000000", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_use_min_delay_socket": "false", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_older_version_delay": "604800", 2024-04-15T23:31:48.596 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_misplaced": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_older_version": "true", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-15T23:31:48.597 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "monmap": "", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-15T23:31:48.598 INFO:teuthology.orchestra.run.smithi102.stdout: "motr_tracing_enabled": "false", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_op_threads": "3", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_cm": "false", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_device_name": "", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_dscp": "96", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_local_gid": "", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_port_num": "1", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-15T23:31:48.599 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_sl": "3", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_support_srq": "true", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_rdma_type": "ib", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_async_reap_threshold": "5", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_before_connect": "false", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_ipv4": "true", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_ipv6": "false", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_msgr1": "true", 2024-04-15T23:31:48.600 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_msgr2": "true", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_port_max": "7568", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_port_min": "6800", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_retry_count": "3", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_bind_retry_delay": "5", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_client": "false", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_mds": "false", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_mgr": "false", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_mon": "false", 2024-04-15T23:31:48.601 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_blackhole_osd": "false", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_client_mode": "crc secure", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_cluster_mode": "crc secure", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_cluster_type": "", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_compress_secure": "false", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_connection_idle_timeout": "900", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_connection_ready_timeout": "10", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_crc_data": "true", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_crc_header": "true", 2024-04-15T23:31:48.602 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_bad_msg": "false", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_bug": "true", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_old_message": "true", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_skipped_message": "false", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_coremask": "0xF", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-15T23:31:48.603 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_enable_tso": "true", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_hugepages": "", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_lro": "true", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_memory_channel": "4", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_pmd": "", 2024-04-15T23:31:48.604 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_port_id": "0", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_dump_on_send": "false", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_initial_backoff": "0.200000", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_delay_max": "1.000000", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_delay_type": "", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-15T23:31:48.605 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_network_congestion": "0", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_inject_socket_failures": "0", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_learn_addr_from_peer": "true", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_max_accept_failures": "4", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_max_backoff": "15.000000", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_mon_client_mode": "secure crc", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-15T23:31:48.606 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_mon_service_mode": "secure crc", 2024-04-15T23:31:48.607 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_osd_compress_min_size": "1024", 2024-04-15T23:31:48.607 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_osd_compress_mode": "none", 2024-04-15T23:31:48.607 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-15T23:31:48.607 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-15T23:31:48.607 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_pq_min_cost": "65536", 2024-04-15T23:31:48.607 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_public_type": "", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_service_mode": "crc secure", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_listen_backlog": "512", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_nodelay": "true", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_tcp_rcvbuf": "0", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "ms_type": "async+posix", 2024-04-15T23:31:48.608 INFO:teuthology.orchestra.run.smithi102.stdout: "no_config_file": "false", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_completion_locks_per_session": "32", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_inflight_ops": "1024", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_tick_interval": "5.000000", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter_timeout": "10.000000", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objectstore_blackhole": "false", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-15T23:31:48.609 INFO:teuthology.orchestra.run.smithi102.stdout: "openssl_engine_opts": "", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_delay_time": "5.000000", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_hist_halflife": "1000", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_max_low_ops": "2", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_max_ops": "4", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-15T23:31:48.610 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_agent_slop": "0.020000", 2024-04-15T23:31:48.611 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-15T23:31:48.611 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-15T23:31:48.611 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_asio_thread_count": "2", 2024-04-15T23:31:48.611 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_async_recovery_min_cost": "100", 2024-04-15T23:31:48.611 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-15T23:31:48.611 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-15T23:31:48.612 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backfill_scan_max": "512", 2024-04-15T23:31:48.612 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backfill_scan_min": "64", 2024-04-15T23:31:48.612 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backoff_on_degraded": "false", 2024-04-15T23:31:48.612 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backoff_on_peering": "false", 2024-04-15T23:31:48.612 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_backoff_on_unfound": "true", 2024-04-15T23:31:48.612 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_beacon_report_interval": "300", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_duration": "30", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_max_block_size": "67108864", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_blkin_trace_all": "false", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-15T23:31:48.613 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-15T23:31:48.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-15T23:31:48.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-15T23:31:48.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_check_for_log_corruption": "false", 2024-04-15T23:31:48.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-15T23:31:48.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-15T23:31:48.614 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_class_update_on_start": "true", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_message_cap": "256", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_message_size_cap": "524288000", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_op_priority": "63", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_client_watch_timeout": "30", 2024-04-15T23:31:48.615 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_command_max_records": "256", 2024-04-15T23:31:48.616 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_compact_on_start": "false", 2024-04-15T23:31:48.616 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-15T23:31:48.616 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-15T23:31:48.616 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-15T23:31:48.616 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_update_on_start": "true", 2024-04-15T23:31:48.616 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_crush_update_weight_set": "true", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_feed_pullee": "-1", 2024-04-15T23:31:48.617 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-15T23:31:48.618 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-15T23:31:48.618 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-15T23:31:48.618 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_misdirected_ops": "false", 2024-04-15T23:31:48.618 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_no_acting_change": "false", 2024-04-15T23:31:48.618 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_no_purge_strays": "false", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_op_order": "false", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_shutdown": "false", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-15T23:31:48.619 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_trim_objects": "false", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_snaps": "false", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-15T23:31:48.620 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_keys": "1024", 2024-04-15T23:31:48.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-15T23:31:48.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-15T23:31:48.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-15T23:31:48.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_stride": "524288", 2024-04-15T23:31:48.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-15T23:31:48.621 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-15T23:31:48.622 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_default_notify_timeout": "30", 2024-04-15T23:31:48.622 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep": "0.000000", 2024-04-15T23:31:48.622 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-15T23:31:48.622 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-15T23:31:48.622 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_discard_disconnected_ops": "true", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_enable_op_tracker": "true", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-15T23:31:48.623 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_info": "true", 2024-04-15T23:31:48.624 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_shutdown": "true", 2024-04-15T23:31:48.624 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-15T23:31:48.624 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-15T23:31:48.624 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-15T23:31:48.624 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-15T23:31:48.624 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-15T23:31:48.625 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_function_tracing": "false", 2024-04-15T23:31:48.625 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_grace": "20", 2024-04-15T23:31:48.625 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_interval": "6", 2024-04-15T23:31:48.625 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-15T23:31:48.625 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_min_peers": "10", 2024-04-15T23:31:48.625 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_min_size": "2000", 2024-04-15T23:31:48.626 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_stale": "600", 2024-04-15T23:31:48.626 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-15T23:31:48.626 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_hit_set_max_size": "100000", 2024-04-15T23:31:48.626 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_hit_set_min_size": "1000", 2024-04-15T23:31:48.626 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-15T23:31:48.626 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-15T23:31:48.627 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-15T23:31:48.627 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-15T23:31:48.627 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-15T23:31:48.627 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-15T23:31:48.627 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_journal_size": "5120", 2024-04-15T23:31:48.627 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_kill_backfill_at": "0", 2024-04-15T23:31:48.628 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-15T23:31:48.628 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_cache_size": "50", 2024-04-15T23:31:48.628 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_dedup": "true", 2024-04-15T23:31:48.628 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_message_max": "40", 2024-04-15T23:31:48.628 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-15T23:31:48.628 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_map_share_max_epochs": "40", 2024-04-15T23:31:48.629 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_attr_name_len": "100", 2024-04-15T23:31:48.629 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_attr_size": "0", 2024-04-15T23:31:48.629 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_backfills": "1", 2024-04-15T23:31:48.629 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_markdown_count": "5", 2024-04-15T23:31:48.629 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_markdown_period": "600", 2024-04-15T23:31:48.629 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_object_name_len": "2048", 2024-04-15T23:31:48.630 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_object_namespace_len": "256", 2024-04-15T23:31:48.630 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_object_size": "134217728", 2024-04-15T23:31:48.630 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-15T23:31:48.630 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-15T23:31:48.630 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pg_blocked_by": "16", 2024-04-15T23:31:48.630 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pg_log_entries": "10000", 2024-04-15T23:31:48.631 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-15T23:31:48.631 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_pgls": "1024", 2024-04-15T23:31:48.631 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_push_cost": "8388608", 2024-04-15T23:31:48.631 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_push_objects": "10", 2024-04-15T23:31:48.631 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_scrubs": "3", 2024-04-15T23:31:48.631 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-15T23:31:48.632 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_trimming_pgs": "2", 2024-04-15T23:31:48.632 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_write_op_reply_len": "64", 2024-04-15T23:31:48.632 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_max_write_size": "90", 2024-04-15T23:31:48.632 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-15T23:31:48.632 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-15T23:31:48.632 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_profile": "balanced", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-15T23:31:48.633 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_base": "805306368", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_cache_min": "134217728", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_target": "4294967296", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_target_autotune": "false", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_min_pg_log_entries": "250", 2024-04-15T23:31:48.634 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_min_recovery_priority": "0", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_report_interval": "5", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_num_cache_shards": "32", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_num_op_tracker_shard": "32", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_numa_auto_affinity": "true", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_numa_node": "-1", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_numa_prefer_iface": "true", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objecter_finishers": "1", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objectstore": "bluestore", 2024-04-15T23:31:48.635 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objectstore_fuse": "false", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_objectstore_tracing": "false", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_complaint_time": "30.000000", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_duration": "600", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_size": "20", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_slow_op_size": "20", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_log_threshold": "5", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_shards": "0", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_shards_hdd": "5", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_shards_ssd": "8", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-15T23:31:48.636 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_pq_min_cost": "65536", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_queue_cut_off": "high", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_op_thread_timeout": "15", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_open_classes_on_start": "true", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_os_flags": "0", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_peering_op_priority": "255", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_delete_cost": "1048576", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_delete_priority": "5", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_log_trim_max": "10000", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_log_trim_min": "100", 2024-04-15T23:31:48.637 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_crimson": "false", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-15T23:31:48.638 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_flags": "0", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_min_size": "0", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_pg_num": "32", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_pgp_num": "0", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_read_ratio": "70", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_size": "2", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_default_type": "replicated", 2024-04-15T23:31:48.639 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_push_per_object_cost": "1000", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recover_clone_overlap": "true", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_cost": "20971520", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_active": "0", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_max_single_start": "1", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_op_priority": "3", 2024-04-15T23:31:48.640 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_priority": "5", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep": "0.000000", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_repair_during_recovery": "false", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_requested_scrub_priority": "120", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_auto_repair": "false", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-15T23:31:48.641 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_begin_hour": "0", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_begin_week_day": "0", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_chunk_max": "25", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_chunk_min": "5", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_cost": "52428800", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_during_recovery": "false", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_end_hour": "0", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_end_week_day": "0", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_event_cost": "4096", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_invalid_stats": "true", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-15T23:31:48.642 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_max_preemptions": "5", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_priority": "5", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_sleep": "0.000000", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_scrub_slow_reservation_response": "30000", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_skip_data_digest": "false", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_smart_report_timeout": "5", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_cost": "1048576", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_priority": "5", 2024-04-15T23:31:48.643 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_target_transaction_size": "30", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-15T23:31:48.644 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_tracing": "false", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_use_stale_snap": "false", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "osdc_blkin_trace_all": "false", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_kill_at": "0", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_max_join_drift": "10", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_min": "500", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_min_wait": "0.050000", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_propose_interval": "1.000000", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_service_trim_max": "500", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_service_trim_min": "250", 2024-04-15T23:31:48.645 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_stash_full_interval": "25", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_trim_max": "500", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "paxos_trim_min": "250", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "perf": "true", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "-", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrv": "", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "public_bind_addr": "-", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "public_network": "", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "public_network_interface": "", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "qat_compressor_enabled": "false", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "qat_compressor_session_max_number": "256", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "rados_mon_op_timeout": "0", 2024-04-15T23:31:48.646 INFO:teuthology.orchestra.run.smithi102.stdout: "rados_osd_op_timeout": "0", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rados_tracing": "false", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_atime_update_interval": "60", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_balance_parent_reads": "false", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_balance_snap_reads": "false", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_blkin_trace_all": "false", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache": "true", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_policy": "writearound", 2024-04-15T23:31:48.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_size": "33554432", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_clone_copy_on_read": "false", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_compression_hint": "none", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_concurrent_management_ops": "10", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_clone_format": "auto", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_data_pool": "", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_features": "61", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_format": "2", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_map_options": "", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_order": "22", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_pool": "rbd", 2024-04-15T23:31:48.648 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_stripe_count": "0", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_default_stripe_unit": "0", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_enable_alloc_hint": "true", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_io_scheduler": "simple", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-15T23:31:48.649 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_order": "24", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_pool": "", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_journal_splay_width": "4", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_localize_parent_reads": "false", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_localize_snap_reads": "false", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-15T23:31:48.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-15T23:31:48.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_mtime_update_interval": "60", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_non_blocking_aio": "true", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_op_thread_timeout": "60", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_op_threads": "1", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_parent_cache_enabled": "false", 2024-04-15T23:31:48.652 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_plugins": "", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_bps_burst": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_bps_limit": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_exclude_ops": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_iops_burst": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_iops_limit": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-15T23:31:48.653 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_read_from_replica_policy": "default", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-15T23:31:48.654 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_skip_partial_discard": "true", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_tracing": "false", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_validate_names": "true", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_validate_pool": "true", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "restapi_base_url": "", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "restapi_log_level": "", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_acl_grants_max_num": "100", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_admin_entry": "admin", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_backend_store": "rados", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_barbican_url": "", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_beast_enable_async": "true", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_counters_cache": "false", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-15T23:31:48.655 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cache_enabled": "true", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cache_expiry_interval": "900", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cache_lru_size": "10000", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_config_store": "rados", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_content_length_compat": "false", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_copy_obj_progress": "true", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-15T23:31:48.656 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cors_rules_max_num": "100", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_cross_domain_policy": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_addr": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_password": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_kmip_username": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_require_ssl": "true", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-15T23:31:48.657 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_addr": "", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_auth": "token", 2024-04-15T23:31:48.658 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_namespace": "", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_prefix": "", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_token_file": "", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_buffersize": "524288", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_low_speed_time": "300", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-15T23:31:48.659 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_d4n_port": "6379", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_changes_size": "1000", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_num_shards": "128", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_log_window": "30", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-15T23:31:48.660 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-15T23:31:48.661 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dns_name": "", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dns_s3website_name": "", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_dynamic_resharding": "true", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-15T23:31:48.662 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_gc_threads": "true", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_lc_threads": "true", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_ops_log": "false", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_quota_threads": "true", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_static_website": "false", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enable_usage_log": "false", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_enforce_swift_acls": "true", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_exit_timeout_secs": "120", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_expose_bucket": "false", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_extended_http_attrs": "", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_filter": "none", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_frontends": "beast port=7480", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-15T23:31:48.663 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_deferred": "50", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_objs": "32", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_gc_processor_period": "3600", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_init_timeout": "300", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-15T23:31:48.664 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_kafka_connection_idle": "300", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_domain": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_password": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_password_path": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_project": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_tenant": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_token": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_token_path": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_admin_user": "", 2024-04-15T23:31:48.665 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_api_version": "2", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_domain": "", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_password": "", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_project": "", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_barbican_user": "", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_url": "", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-15T23:31:48.666 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_debug_interval": "-1", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_lock_max_time": "90", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_objs": "32", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_rules": "1000", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_worker": "3", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lc_thread_delay": "0", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_dnattr": "uid", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_searchfilter": "", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-15T23:31:48.667 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_http_headers": "", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_log_object_name_utc": "false", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_attr_name_len": "0", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_attr_size": "0", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_chunk_size": "4194304", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-15T23:31:48.668 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_listing_results": "1000", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_notify_retries": "10", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_put_param_size": "1048576", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_put_size": "5368709120", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_max_slo_entries": "1000", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_md_log_max_shards": "64", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_mp_lock_max_time": "600", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-15T23:31:48.669 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_max_gc": "300", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_num_async_rados_threads": "32", 2024-04-15T23:31:48.670 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_num_control_oids": "8", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_numa_node": "-1", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_objexp_chunk_size": "100", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_objexp_gc_interval": "600", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_op_thread_timeout": "600", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_op_tracing": "false", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_opa_token": "", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_opa_url": "", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_opa_verify_ssl": "true", 2024-04-15T23:31:48.671 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_rados": "false", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_ops_log_socket_path": "", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_push_interval": "2.000000", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_lanes": "3", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-15T23:31:48.672 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_cache_partitions": "3", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_print_continue": "true", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rados_tracing": "false", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_realm": "", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_realm_id": "", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_region": "", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-15T23:31:48.673 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_request_uri": "", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_batch_size": "64", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_max_aio": "128", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_num_logs": "16", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_reshard_thread_interval": "600", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_resolve_cname": "false", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_run_sync_thread": "true", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-15T23:31:48.674 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_scheduler_type": "throttler", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_script_uri": "", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_service_provider_name": "", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_client_id": "", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_client_secret": "", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_entry": "sts", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_key": "sts", 2024-04-15T23:31:48.675 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_min_session_duration": "900", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sts_token_introspection_url": "", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_account_in_url": "false", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_auth_entry": "auth", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_auth_url": "", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_custom_header": "", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_need_stats": "true", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_tenant_name": "", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_token_expiration": "86400", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_url": "", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_url_prefix": "swift", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-15T23:31:48.676 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_lease_period": "120", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_thread_pool_size": "512", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-15T23:31:48.677 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_comment": "", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_createby": "", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_encoding": "", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_flag": "false", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_origin": "", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_torrent_tracker": "", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_trust_forwarded_https": "false", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_max_shards": "32", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_usage_max_user_shards": "1", 2024-04-15T23:31:48.678 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_use_opa_authz": "false", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_counters_cache": "false", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_max_buckets": "1000", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_policies_max_num": "100", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_user_unique_email": "true", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_verify_ssl": "true", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zone": "", 2024-04-15T23:31:48.679 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zone_id": "", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zonegroup": "", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zonegroup_id": "", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rgwlc_auto_session_clear": "true", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_block_size": "4096", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-15T23:31:48.680 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_size": "536870912", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_index_type": "binary_search", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_partition_filters": "false", 2024-04-15T23:31:48.681 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_perf": "false", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "run_dir": "/var/run/ceph", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_block_create": "true", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_cache_lru_size": "67108864", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_default_max_object_size": "16777216", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_device_size": "53687091200", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_batch_capacity": "16", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-15T23:31:48.682 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_main_device_type": "SSD", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "seastore_segment_size": "67108864", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "set_keepcaps": "false", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "setgroup": "", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "setuser": "", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "setuser_match_path": "", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "thp": "false", 2024-04-15T23:31:48.683 INFO:teuthology.orchestra.run.smithi102.stdout: "threadpool_default_timeout": "60", 2024-04-15T23:31:48.684 INFO:teuthology.orchestra.run.smithi102.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-15T23:31:48.684 INFO:teuthology.orchestra.run.smithi102.stdout: "throttler_perf_counter": "true" 2024-04-15T23:31:48.684 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:31:48.686 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-15T23:31:48.802 INFO:teuthology.orchestra.run.smithi102.stdout:mon.a: {} 2024-04-15T23:31:48.802 INFO:teuthology.orchestra.run.smithi102.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-15T23:31:48.810 INFO:teuthology.orchestra.run.smithi102.stdout:mon.b: {} 2024-04-15T23:31:48.810 INFO:teuthology.orchestra.run.smithi102.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-15T23:31:48.822 INFO:teuthology.orchestra.run.smithi102.stdout:mon.c: {} 2024-04-15T23:31:48.822 INFO:teuthology.orchestra.run.smithi102.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-15T23:31:48.830 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-15T23:31:48.830 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-15T23:31:48.857 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-15T23:31:48.858 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-15T23:31:48.858 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-15T23:31:48.858 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-15T23:31:48.858 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:48.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:48.858 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-04-15T23:31:48.859 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-15T23:31:48.859 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-15T23:31:48.859 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:31:48.859 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-15T23:31:48.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-15T23:31:48.860 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-15T23:31:48.860 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-15T23:31:48.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:31:48.861 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-15T23:31:48.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:48.861 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-15T23:31:48.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:31:48.863 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:48.877+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:48.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:48.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-04-15T23:31:48.949 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-04-15T23:31:48.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:31:48.951 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-15T23:31:48.951 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-15T23:31:48.962 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:48.978+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:48.982 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:48.982 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:48.982 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:31:48.982 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:48.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:48.995 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:31:48.995 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:31:49.016 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:31:49.016 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:31:49.034 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:31:49.035 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:31:49.063 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:49.080+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:49.101 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.101 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:49.164 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:49.180+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:49.187 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:49.187 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 15, 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-04-15T23:31:15.484738+0000", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-04-15T23:31:31.867515+0000", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-04-15T23:31:23.575432+0000", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-04-15T23:31:16.326489+0000", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5799936, 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-04-15T23:31:49.188 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 4, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 4, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 3, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "jewel", 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-04-15T23:31:49.189 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.797113+0000", 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:49.190 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:49.191 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:49.192 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:49.193 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:49.194 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-04-15T23:31:49.195 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.948719+0000", 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-04-15T23:31:49.196 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:49.197 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:49.198 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:49.199 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.5, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.5, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 1, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5, 2024-04-15T23:31:49.200 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_metadata", 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:28.382708+0000", 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:49.201 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:49.202 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:49.202 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:49.202 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:49.202 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:49.202 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:49.202 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:49.203 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "14", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:49.204 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:49.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:31:49.206 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_bias": 4, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 16, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_priority": 5 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": "cephfs" 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.1299999952316284, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.1299999952316284, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 1, 2024-04-15T23:31:49.207 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 4, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_data", 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:29.186157+0000", 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:49.208 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 64, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 64, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 64, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 64, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 64, 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:49.209 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "15", 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:49.210 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:49.211 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:49.212 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 64, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "target_size_ratio": 0.89999997615814209 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "data": "cephfs" 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.1299999952316284, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.1299999952316284, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 1, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:31:49.213 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "37ee61ed-86ab-4308-a161-cd2aafcfd4f9", 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:31:49.214 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6800", 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.215 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6801", 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6802", 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.216 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6803", 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6806", 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6807", 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6804", 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.218 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6805", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.107:6801/1269237815", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.107:6803/1269237815", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.107:6807/1269237815", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.107:6805/1269237815", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.219 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "9631dded-d96a-40ad-945d-252291b498da", 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6800", 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6801", 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6802", 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6803", 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.222 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6806", 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6807", 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6804", 2024-04-15T23:31:49.223 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6805", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.115:6801/1544615186", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.115:6803/1544615186", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.115:6807/1544615186", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.115:6805/1544615186", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:31:49.224 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "45415c3c-3208-4cab-b6d2-75f250746bef", 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:31:49.225 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6800", 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6801", 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.226 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6802", 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6803", 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.227 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6806", 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6807", 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:31:49.228 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6804", 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6805", 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.195:6801/2023242123", 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.195:6803/2023242123", 2024-04-15T23:31:49.229 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.195:6807/2023242123", 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.195:6805/2023242123", 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:31:49.230 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.385592+0000", 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.370073+0000", 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.231 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.369726+0000", 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [], 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-04-15T23:31:49.232 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-04-15T23:31:49.233 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:49.234 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:31:49.235 INFO:tasks.thrashosds.thrasher:j is {'epoch': 15, 'fsid': '60f632e8-f087-41df-a0b6-043b99131bd6', 'created': '2024-04-15T23:31:15.484738+0000', 'modified': '2024-04-15T23:31:31.867515+0000', 'last_up_change': '2024-04-15T23:31:23.575432+0000', 'last_in_change': '2024-04-15T23:31:16.326489+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 1269237815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 1269237815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 1269237815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 1269237815}]}, 'public_addr': '172.21.15.107:6801/1269237815', 'cluster_addr': '172.21.15.107:6803/1269237815', 'heartbeat_back_addr': '172.21.15.107:6807/1269237815', 'heartbeat_front_addr': '172.21.15.107:6805/1269237815', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9631dded-d96a-40ad-945d-252291b498da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 1544615186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 1544615186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 1544615186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 1544615186}]}, 'public_addr': '172.21.15.115:6801/1544615186', 'cluster_addr': '172.21.15.115:6803/1544615186', 'heartbeat_back_addr': '172.21.15.115:6807/1544615186', 'heartbeat_front_addr': '172.21.15.115:6805/1544615186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '45415c3c-3208-4cab-b6d2-75f250746bef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 2023242123}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 2023242123}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 2023242123}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 2023242123}]}, 'public_addr': '172.21.15.195:6801/2023242123', 'cluster_addr': '172.21.15.195:6803/2023242123', 'heartbeat_back_addr': '172.21.15.195:6807/2023242123', 'heartbeat_front_addr': '172.21.15.195:6805/2023242123', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.385592+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.370073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.369726+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-15T23:31:49.236 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-15T23:31:49.259 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.259 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.265 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:49.281+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:49.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:49.329 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-15T23:31:49.341 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-15T23:31:49.341 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-15T23:31:49.342 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-15T23:31:49.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:49.342 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-04-15T23:31:49.358 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-04-15T23:31:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-04-15T23:31:49.360 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-15T23:31:49.360 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-04-15T23:31:49.366 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:49.382+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:49.388 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.388 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.398 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:49.427 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:31:49.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T23:31:49.467 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:49.483+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:49.506 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.506 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:49.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T23:31:49.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:49.563 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-15T23:31:49.567 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:49.583+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:49.624 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.624 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.630 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-04-15T23:31:49.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:49.632 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-04-15T23:31:49.633 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:49.674 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:49.690+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:49.701 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-04-15T23:31:49.701 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-15T23:31:49.701 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-15T23:31:49.701 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-15T23:31:49.701 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-15T23:31:49.702 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T23:31:49.702 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-04-15T23:31:49.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-15T23:31:49.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-15T23:31:49.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-15T23:31:49.702 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-04-15T23:31:49.752 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.752 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.762 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:49.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T23:31:49.807 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:49.824+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:49.870 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:49.885+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:49.870 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:49.870 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:49.879 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:49.970 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:49.986+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:50.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T23:31:50.027 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.027 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:50.033 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-04-15T23:31:50.036 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:50.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:50.048 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-04-15T23:31:50.071 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:50.087+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:50.104 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T23:31:50.104 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-04-15T23:31:50.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T23:31:50.105 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-15T23:31:50.105 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-04-15T23:31:50.148 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.148 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:50.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T23:31:50.200 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:50.217+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:50.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T23:31:50.230 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-15T23:31:50.230 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-04-15T23:31:50.264 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.265 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.273 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:50.289+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:50.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:50.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T23:31:50.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T23:31:50.372 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-15T23:31:50.372 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-04-15T23:31:50.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-04-15T23:31:50.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-04-15T23:31:50.372 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-04-15T23:31:50.374 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:50.390+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:50.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-15T23:31:50.423 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.423 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.432 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:50.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T23:31:50.458 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-15T23:31:50.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T23:31:50.459 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:50.473 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-15T23:31:50.473 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-15T23:31:50.474 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:50.475 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:50.491+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:50.528 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-04-15T23:31:50.545 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.545 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.554 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:50.575 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:50.592+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:50.597 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T23:31:50.653 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-04-15T23:31:50.653 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-04-15T23:31:50.653 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-04-15T23:31:50.654 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T23:31:50.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:50.656 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-04-15T23:31:50.676 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:50.692+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:50.701 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.701 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.708 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-15T23:31:50.709 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-15T23:31:50.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:50.751 DEBUG:teuthology.orchestra.run.smithi102:> sudo modprobe fuse 2024-04-15T23:31:50.777 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:50.793+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:50.779 DEBUG:teuthology.orchestra.run.smithi102:> cat /proc/self/mounts | awk '{print $2}' 2024-04-15T23:31:50.818 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.818 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.827 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:50.835 INFO:teuthology.orchestra.run.smithi102.stdout:/proc 2024-04-15T23:31:50.835 INFO:teuthology.orchestra.run.smithi102.stdout:/sys 2024-04-15T23:31:50.835 INFO:teuthology.orchestra.run.smithi102.stdout:/dev 2024-04-15T23:31:50.835 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/security 2024-04-15T23:31:50.835 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/shm 2024-04-15T23:31:50.835 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/pts 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/run 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/cgroup 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/pstore 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/bpf 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/ 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/selinux 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/proc/sys/fs/binfmt_misc 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/hugepages 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/dev/mqueue 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/debug 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/tracing 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/fs/fuse/connections 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/sys/kernel/config 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-sysctl.service 2024-04-15T23:31:50.836 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/nfs/rpc_pipefs 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/run/user/1000 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/var/lib/ceph 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T23:31:50.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:50.837 DEBUG:teuthology.orchestra.run.smithi102:> ls /sys/fs/fuse/connections 2024-04-15T23:31:50.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:2024-04-15T23:31:50.870+0000 7fca4380b480 -1 init, newargv = 0x56211bf8d880 newargc=15 2024-04-15T23:31:50.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[34209]: starting ceph client 2024-04-15T23:31:50.859 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[34209]: starting fuse 2024-04-15T23:31:50.870 INFO:teuthology.orchestra.run.smithi102.stdout:41 2024-04-15T23:31:50.871 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo stdin-killer -- python3 -c ' 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> import glob 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> import re 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> import os 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> import subprocess 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> def _find_admin_socket(client_name): 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> files = glob.glob(asok_path) 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> 2024-04-15T23:31:50.871 DEBUG:teuthology.orchestra.run.smithi102:> # Given a non-glob path, it better be there 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> if "*" not in asok_path: 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> assert(len(files) == 1) 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> return files[0] 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> for f in files: 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> contents = proc_f.read() 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> if mountpoint in contents: 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> return f 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> print(_find_admin_socket("client.0")) 2024-04-15T23:31:50.872 DEBUG:teuthology.orchestra.run.smithi102:> ' 2024-04-15T23:31:50.878 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:50.894+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:50.940 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:50.940 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:50.949 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:50.979 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:50.996+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:50.993 INFO:teuthology.orchestra.run.smithi102.stdout:/var/run/ceph/ceph-client.0.34209.asok 2024-04-15T23:31:50.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-04-15T23:31:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-15T23:31:51.004 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34209.asok 2024-04-15T23:31:51.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:51.004 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34209.asok status 2024-04-15T23:31:51.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:31:51.057 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:51.057 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:51.065 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:51.080 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:51.096+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:51.144 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:31:51.144 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": { 2024-04-15T23:31:51.144 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_sha1": "a9a752df26c63acad72e1b3569fd79a515ca0765", 2024-04-15T23:31:51.144 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.0.0-2114-ga9a752df (a9a752df26c63acad72e1b3569fd79a515ca0765) squid (dev)", 2024-04-15T23:31:51.144 INFO:teuthology.orchestra.run.smithi102.stdout: "entity_id": "0", 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": "smithi102", 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "pid": "34209", 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "root": "/" 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_count": 0, 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "dentry_pinned_count": 0, 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 4525, 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "inst": { 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "name": { 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "client", 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "num": 4525 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:51.145 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1735269682 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": { 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "192.168.0.1:0", 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1735269682 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "inst_str": "client.4525 192.168.0.1:0/1735269682", 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "addr_str": "192.168.0.1:0/1735269682", 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "inode_count": 1, 2024-04-15T23:31:51.146 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_epoch": 5, 2024-04-15T23:31:51.147 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch": 16, 2024-04-15T23:31:51.147 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_epoch_barrier": 0, 2024-04-15T23:31:51.147 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklisted": false, 2024-04-15T23:31:51.147 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs" 2024-04-15T23:31:51.147 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:31:51.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:51.153 DEBUG:teuthology.orchestra.run.smithi102:> stat --file-system '--printf=%T 2024-04-15T23:31:51.153 DEBUG:teuthology.orchestra.run.smithi102:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:51.169 INFO:teuthology.orchestra.run.smithi102.stdout:fuseblk 2024-04-15T23:31:51.169 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:51.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:31:51.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:51.173 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:51.173 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:51.181 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:51.196+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:51.182 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:51.216 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:31:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:31:51.234 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:31:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:31:51.238 INFO:teuthology.run_tasks:Running task workunit... 2024-04-15T23:31:51.253 INFO:tasks.workunit:Pulling workunits from ref 461a84e6fbbf089011eafd13b98169fb9e9b8cc9 2024-04-15T23:31:51.253 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-15T23:31:51.253 INFO:tasks.workunit:timeout=6h 2024-04-15T23:31:51.253 INFO:tasks.workunit:cleanup=True 2024-04-15T23:31:51.253 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:51.254 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:31:51.255 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-04-15 23:31:30.863866311 +0000 2024-04-15T23:31:51.270 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-04-15 23:31:51.254284087 +0000 2024-04-15T23:31:51.271 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-04-15T23:31:51.271 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-15T23:31:51.271 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-15T23:31:51.282 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:51.298+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:51.297 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:31:51.298 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:51.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:51.343 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 461a84e6fbbf089011eafd13b98169fb9e9b8cc9 2024-04-15T23:31:51.383 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:51.399+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:51.400 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-15T23:31:51.414 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:51.414 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:51.414 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:31:51.414 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:31:51.415 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:51.423 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:51.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:31:51.507 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:51.523+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.517043472000001, 2024-04-15T23:31:51.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:51.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:51.578 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.516350928000001, 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:31:51.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.515959014, 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:31:51.583 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:31:51.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:31:51.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.515624569, 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:31:51.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.514329216, 2024-04-15T23:31:51.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:51.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:31:51.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:31:51.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.162063353000001, 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:31:51.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:31:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.161840350999999, 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:31:51.603 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:31:51.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.607 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.161399507999999, 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:31:51.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.160747551, 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:31:51.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.617 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.159941283999999, 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:31:51.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.157840790000002, 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:31:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:31:51.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.627 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.720376712, 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:31:51.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:31:51.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:31:51.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.720319967999998, 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:31:51.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:31:51.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.720208811999999, 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:31:51.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:31:51.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.720121798000001, 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:31:51.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:31:51.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.720088097000001, 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:31:51.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:31:51.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.719899558000002, 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:31:51.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:51.666 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.719855339999999, 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:51.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:31:51.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:31:51.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.719814841000002, 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:31:51.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.719773131, 2024-04-15T23:31:51.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:51.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:51.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:31:51.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:31:51.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:51.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:51.681 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:51.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:51.684 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:51.700+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:51.783 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:51.800+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:51.801 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:51.801 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:51.801 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:31:51.801 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:51.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:51.885 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:51.901+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:51.918 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:51.918 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:51.918 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:31:51.919 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:31:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:51.927 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:51.986 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:52.002+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:52.038 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:52.038 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:31:52.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:31:52.038 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.984204990999999, 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.039 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:31:52.044 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.984123502999999, 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:52.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.186031812, 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.050 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:31:52.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:31:52.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.055 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185983822000001, 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185945523000001, 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.065 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185906735, 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:52.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:31:52.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:31:52.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185883403999998, 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:31:52.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:31:52.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185852918999998, 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:31:52.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185817849999999, 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:31:52.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:31:52.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:31:52.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:31:52.086 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185794107, 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.092 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185769848, 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185741509, 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:52.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:31:52.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185702710000001, 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.103 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:31:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:31:52.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:31:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:31:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:31:52.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:31:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:31:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:31:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:31:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:31:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:31:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:31:52.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:31:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:31:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:31:52.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:31:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:31:52.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185667539000001, 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.115 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:31:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:31:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:31:52.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:31:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:31:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:31:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:31:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:31:52.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:31:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.125 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185634171, 2024-04-15T23:31:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:31:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.126 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:31:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:31:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:31:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:31:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:31:52.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:31:52.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:31:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:31:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:31:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:31:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.136 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.185576709999999, 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:31:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:31:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:31:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:31:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:31:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:31:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:31:52.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:31:52.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:31:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:31:52.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:31:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:31:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:31:52.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:31:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:31:52.147 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.183941050000001, 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.148 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:31:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:31:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:31:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:31:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:31:52.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:31:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:31:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:31:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:31:52.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:31:52.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:31:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.183049518000001, 2024-04-15T23:31:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:31:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.159 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:31:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:31:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:31:52.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:31:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:31:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:31:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:31:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:31:52.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.182998170000001, 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:31:52.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:31:52.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:31:52.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:31:52.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 21.182960053999999, 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:31:52.177 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:52.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:52.181 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:52.182 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:52.183 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:52.199+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:52.283 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:52.300+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:52.302 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:52.303 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:31:52.303 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:31:52.303 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:52.312 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:52.385 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:52.401+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:52.443 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:31:52.461 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:31:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-15T23:31:52.462 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-15T23:31:52.462 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:52.471 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:52.514 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:52.531+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.727520629000001, 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016751775999999999, 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.580 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867736+0000", 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2537999999999999e-05 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867743+0000", 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4279999999999999e-06 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867756+0000", 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2774e-05 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867783+0000", 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7722e-05 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868423+0000", 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00063940899999999996 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.583 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868430+0000", 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7880000000000001e-06 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876493+0000", 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0080637980000000005 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876624+0000", 2024-04-15T23:31:52.584 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013080599999999999 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877204+0000", 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057935099999999998 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881649+0000", 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044450940000000001 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884341+0000", 2024-04-15T23:31:52.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026923139999999999 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884405+0000", 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4220999999999994e-05 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884475+0000", 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9533e-05 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:7 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.726905947999999, 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016252260000000001, 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6000000000000002e-07 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868345+0000", 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0580000000000003e-06 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868354+0000", 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6059999999999992e-06 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868362+0000", 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1429999999999998e-06 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868677+0000", 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000314383 2024-04-15T23:31:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868684+0000", 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4320000000000002e-06 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877636+0000", 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0089513189999999992 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877748+0000", 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111993 2024-04-15T23:31:52.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877866+0000", 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000118721 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881773+0000", 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039063989999999996 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884521+0000", 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027486450000000001 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884558+0000", 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6371000000000001e-05 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884590+0000", 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2329999999999997e-05 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.592 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.726829687999999, 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013223400999999999, 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868415+0000", 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0500000000000003e-07 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868427+0000", 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.201e-05 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868435+0000", 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1920000000000005e-06 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868445+0000", 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9909999999999997e-06 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868650+0000", 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00020519700000000001 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868657+0000", 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5060000000000001e-06 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875798+0000", 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007141072 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876016+0000", 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000218316 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876164+0000", 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014811300000000001 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880696+0000", 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045315370000000004 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881556+0000", 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086031699999999998 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881600+0000", 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4335000000000002e-05 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881637+0000", 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7110000000000002e-05 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:52.598 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.726788120999998, 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013308986, 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:52.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4099999999999998e-07 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868460+0000", 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2740000000000001e-06 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868467+0000", 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3899999999999998e-06 2024-04-15T23:31:52.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868479+0000", 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1951e-05 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868711+0000", 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000232465 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868715+0000", 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1860000000000002e-06 2024-04-15T23:31:52.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876682+0000", 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079668489999999998 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876769+0000", 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6967999999999998e-05 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877143+0000", 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00037359300000000003 2024-04-15T23:31:52.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880775+0000", 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036317979999999999 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881652+0000", 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00087763100000000003 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881715+0000", 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2788999999999998e-05 2024-04-15T23:31:52.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881765+0000", 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450999999999998e-05 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.726697981000001, 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016167357, 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.604 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868547+0000", 2024-04-15T23:31:52.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2999999999999999e-07 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868551+0000", 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.848e-06 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868567+0000", 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.5319999999999999e-05 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868575+0000", 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8790000000000003e-06 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017436900000000001 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868761+0000", 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.182e-05 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878325+0000", 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0095639330000000002 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878481+0000", 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015608399999999999 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878620+0000", 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000139288 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881779+0000", 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031593540000000001 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884634+0000", 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0028545049999999998 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884674+0000", 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9878e-05 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884713+0000", 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9249000000000003e-05 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.726646002999999, 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015469673, 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.610 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8100000000000002e-07 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868603+0000", 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6770000000000003e-06 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868613+0000", 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5699999999999999e-06 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868620+0000", 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2830000000000004e-06 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869826+0000", 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0012064339999999999 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869832+0000", 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0290000000000002e-06 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874065+0000", 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0042329510000000004 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874220+0000", 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015491699999999999 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874405+0000", 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018499599999999999 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879828+0000", 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0054231410000000002 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883969+0000", 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041404559999999998 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884024+0000", 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4944000000000001e-05 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884067+0000", 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3494000000000001e-05 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.726307329000001, 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015273920999999999, 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.616 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868937+0000", 2024-04-15T23:31:52.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.47e-07 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868947+0000", 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6730000000000004e-06 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868959+0000", 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1956999999999999e-05 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868968+0000", 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.3009999999999995e-06 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869942+0000", 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00097338899999999996 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869946+0000", 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7550000000000002e-06 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875078+0000", 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051312529999999997 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000148949 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884210+0000", 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008983797 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.620 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.725389706000001, 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014939332, 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869855+0000", 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9599999999999998e-07 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869860+0000", 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9779999999999996e-06 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869871+0000", 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1032e-05 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869880+0000", 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9600000000000006e-06 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869979+0000", 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9392e-05 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869983+0000", 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6380000000000002e-06 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879365+0000", 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093823139999999992 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879554+0000", 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018925300000000001 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884793+0000", 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052388690000000002 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.725344046, 2024-04-15T23:31:52.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.01118678, 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8599999999999998e-07 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869903+0000", 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9979999999999999e-06 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869999+0000", 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5710000000000004e-05 2024-04-15T23:31:52.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870008+0000", 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1600000000000004e-06 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870654+0000", 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00064568299999999998 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870660+0000", 2024-04-15T23:31:52.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0769999999999996e-06 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876226+0000", 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055662949999999997 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876342+0000", 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011568700000000001 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881086+0000", 2024-04-15T23:31:52.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0047445839999999996 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.724635073999998, 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.006624909, 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.630 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7399999999999999e-07 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.631 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870622+0000", 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2914e-05 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870653+0000", 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0806000000000003e-05 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870670+0000", 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.694e-05 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.632 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.872456+0000", 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017861940000000001 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877234+0000", 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004777781 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:31:52.633 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.721566698, 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0058784350000000004, 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.634 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.67e-07 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873697+0000", 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9491999999999999e-05 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.635 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873708+0000", 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0893999999999999e-05 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873726+0000", 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7999000000000002e-05 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873911+0000", 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018578600000000001 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.636 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873936+0000", 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4454999999999999e-05 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879501+0000", 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055647470000000001 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879555+0000", 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4795e-05 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.637 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.717773115, 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037213989999999998, 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.638 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877477+0000", 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3319999999999997e-06 2024-04-15T23:31:52.639 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877486+0000", 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0550000000000005e-06 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877505+0000", 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8844000000000001e-05 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877620+0000", 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114393 2024-04-15T23:31:52.640 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877639+0000", 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8788e-05 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881149+0000", 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003510862 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881192+0000", 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2571000000000003e-05 2024-04-15T23:31:52.641 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.717723941999999, 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037611580000000001, 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.642 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.72e-07 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.643 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877531+0000", 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.075e-05 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877540+0000", 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8680000000000005e-06 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877547+0000", 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.3839999999999999e-06 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.644 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877942+0000", 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00039470199999999998 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877960+0000", 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8241999999999999e-05 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881250+0000", 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032902949999999999 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.645 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881281+0000", 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0545e-05 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.717686411999999, 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037922429999999998, 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.646 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877558+0000", 2024-04-15T23:31:52.647 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1899999999999998e-07 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877564+0000", 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5409999999999997e-06 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877572+0000", 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5549999999999997e-06 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877579+0000", 2024-04-15T23:31:52.648 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8190000000000003e-06 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877735+0000", 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000156133 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877754+0000", 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9559e-05 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.649 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881307+0000", 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00355296 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881349+0000", 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2256999999999999e-05 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 3 lcod 14'1)", 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.714902041999999, 2024-04-15T23:31:52.650 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00023478400000000001, 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.651 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2799999999999996e-07 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880346+0000", 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4359999999999998e-06 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880461+0000", 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011513700000000001 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.652 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880470+0000", 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7900000000000005e-06 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880527+0000", 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7095999999999997e-05 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880576+0000", 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9796999999999998e-05 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.653 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.711318982000002, 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029033999999999999, 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:52.654 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9400000000000001e-07 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883929+0000", 2024-04-15T23:31:52.655 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9890000000000003e-06 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883938+0000", 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4640000000000006e-06 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883944+0000", 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8870000000000003e-06 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884099+0000", 2024-04-15T23:31:52.656 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015466199999999999 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884215+0000", 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115944 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:7 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.710944034000001, 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029787699999999999, 2024-04-15T23:31:52.657 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.658 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9099999999999999e-07 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884303+0000", 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1240000000000001e-06 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884310+0000", 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1330000000000001e-06 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.659 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884317+0000", 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9920000000000001e-06 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884512+0000", 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00019436900000000001 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884518+0000", 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1770000000000003e-06 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.660 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884598+0000", 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9691000000000007e-05 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 21.710858951999999, 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033810099999999999, 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.661 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.662 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2600000000000002e-07 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884389+0000", 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8449999999999996e-06 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884398+0000", 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.663 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884404+0000", 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0780000000000001e-06 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884623+0000", 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00021912599999999999 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884630+0000", 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9419999999999998e-06 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.664 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884723+0000", 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2597999999999997e-05 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 19.729181088000001, 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052092120000000004, 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.665 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866064+0000", 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.813e-06 2024-04-15T23:31:52.666 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866072+0000", 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866085+0000", 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3179e-05 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866091+0000", 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0809999999999999e-06 2024-04-15T23:31:52.667 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866178+0000", 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6945000000000002e-05 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866183+0000", 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4710000000000001e-06 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869710+0000", 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0035276610000000001 2024-04-15T23:31:52.668 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869800+0000", 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0153000000000002e-05 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869885+0000", 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4478e-05 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.870362+0000", 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047698899999999998 2024-04-15T23:31:52.669 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871210+0000", 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00084789999999999996 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871244+0000", 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4561999999999999e-05 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871272+0000", 2024-04-15T23:31:52.670 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7461999999999999e-05 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 0.72715557099999995, 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001586395, 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.671 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868089+0000", 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1710000000000001e-06 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.672 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868098+0000", 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868115+0000", 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6843000000000001e-05 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868143+0000", 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7512e-05 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.673 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868212+0000", 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9487999999999996e-05 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868288+0000", 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5629000000000004e-05 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868389+0000", 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100985 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.674 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869162+0000", 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00077331800000000005 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869608+0000", 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00044655299999999998 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869642+0000", 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4010000000000001e-05 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:52.675 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869674+0000", 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1999999999999999e-05 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:52.676 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:52.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:52.678 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:52.694+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:52.779 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:52.795+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:52.798 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:31:52.798 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:52.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:52.879 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:52.896+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:52.957 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:52.957 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:52.957 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:31:52.957 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:31:52.957 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:52.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:52.980 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:52.996+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:31:53.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.020460022000002, 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.080 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.019767477999999, 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.019375564000001, 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.085 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:31:53.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.019041119000001, 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.093 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.017745766000001, 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:31:53.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:31:53.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.665479903000001, 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:31:53.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.665256900999999, 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:31:53.106 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.664816058, 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:53.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:31:53.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.664164101000001, 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:31:53.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:31:53.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:31:53.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.663357833999999, 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.661257339999999, 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:31:53.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:31:53.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:53.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223793262000001, 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:31:53.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:31:53.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:31:53.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223736517999999, 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223625362, 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:31:53.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:31:53.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:31:53.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223538348000002, 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:31:53.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:31:53.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223504646999999, 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:31:53.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:31:53.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:31:53.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223316107999999, 2024-04-15T23:31:53.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:31:53.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:31:53.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:31:53.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.157 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223271889999999, 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:31:53.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223231390999999, 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.166 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.223189681000001, 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:53.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:53.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:53.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:53.171 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:53.171 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:53.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:53.173 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:53.189+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:53.263 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:31:53.272 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:53.289+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:53.293 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:31:53.293 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:53.302 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:53.373 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:53.390+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:53.401 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:31:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:31:53.410 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:53.410 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:53.410 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:31:53.410 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:31:53.410 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:53.419 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:53.419 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:31:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:31:53.436 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:31:53.437 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:31:53.474 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:53.490+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:53.528 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:53.528 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:53.537 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:53.583 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:53.600+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:53.657 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:53.657 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:53.666 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:53.675 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:53.692+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:53.776 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:53.793+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:53.815 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:53.815 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:53.825 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:53.877 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:53.893+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:53.933 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:53.933 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:53.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:53.978 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:53.995+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:54.058 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.059 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:54.079 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:54.096+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:54.176 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.177 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.180 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:54.197+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:54.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:54.236 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-15T23:31:54.236 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:31:54.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:54.281 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:54.297+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:54.293 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.294 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.303 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:54.382 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:54.398+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:54.419 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.420 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.428 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:54.457 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:31:54.483 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:54.500+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:54.531 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:54.532 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:31:54.535 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.535 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.542 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-15T23:31:53.772266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95156,"kb_used_data":1608,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020364,"statfs":{"total":289910292480,"available":289812852736,"internally_reserved":0,"allocated":1646592,"data_stored":1323805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001216"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882232+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:31.882232+0000","last_peered":"2024-04-15T23:31:31.882232+0000","last_clean":"2024-04-15T23:31:31.882232+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:31.882232+0000","last_undegraded":"2024-04-15T23:31:31.882232+0000","last_fullsized":"2024-04-15T23:31:31.882232+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881959+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:31.881959+0000","last_peered":"2024-04-15T23:31:31.881959+0000","last_clean":"2024-04-15T23:31:31.881959+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:31.881959+0000","last_undegraded":"2024-04-15T23:31:31.881959+0000","last_fullsized":"2024-04-15T23:31:31.881959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873116+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:32.873116+0000","last_peered":"2024-04-15T23:31:32.873116+0000","last_clean":"2024-04-15T23:31:32.873116+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:32.873116+0000","last_undegraded":"2024-04-15T23:31:32.873116+0000","last_fullsized":"2024-04-15T23:31:32.873116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872895+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:32.872895+0000","last_peered":"2024-04-15T23:31:32.872895+0000","last_clean":"2024-04-15T23:31:32.872895+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:32.872895+0000","last_undegraded":"2024-04-15T23:31:32.872895+0000","last_fullsized":"2024-04-15T23:31:32.872895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881576+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:31.881576+0000","last_peered":"2024-04-15T23:31:31.881576+0000","last_clean":"2024-04-15T23:31:31.881576+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:31.881576+0000","last_undegraded":"2024-04-15T23:31:31.881576+0000","last_fullsized":"2024-04-15T23:31:31.881576+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872413+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:32.872413+0000","last_peered":"2024-04-15T23:31:32.872413+0000","last_clean":"2024-04-15T23:31:32.872413+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:32.872413+0000","last_undegraded":"2024-04-15T23:31:32.872413+0000","last_fullsized":"2024-04-15T23:31:32.872413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872547+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:32.872547+0000","last_peered":"2024-04-15T23:31:32.872547+0000","last_clean":"2024-04-15T23:31:32.872547+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:32.872547+0000","last_undegraded":"2024-04-15T23:31:32.872547+0000","last_fullsized":"2024-04-15T23:31:32.872547+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872247+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:32.872247+0000","last_peered":"2024-04-15T23:31:32.872247+0000","last_clean":"2024-04-15T23:31:32.872247+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:32.872247+0000","last_undegraded":"2024-04-15T23:31:32.872247+0000","last_fullsized":"2024-04-15T23:31:32.872247+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869374+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:32.869374+0000","last_peered":"2024-04-15T23:31:32.869374+0000","last_clean":"2024-04-15T23:31:32.869374+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:32.869374+0000","last_undegraded":"2024-04-15T23:31:32.869374+0000","last_fullsized":"2024-04-15T23:31:32.869374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881987+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:31.881987+0000","last_peered":"2024-04-15T23:31:31.881987+0000","last_clean":"2024-04-15T23:31:31.881987+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:31.881987+0000","last_undegraded":"2024-04-15T23:31:31.881987+0000","last_fullsized":"2024-04-15T23:31:31.881987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873095+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:32.873095+0000","last_peered":"2024-04-15T23:31:32.873095+0000","last_clean":"2024-04-15T23:31:32.873095+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:32.873095+0000","last_undegraded":"2024-04-15T23:31:32.873095+0000","last_fullsized":"2024-04-15T23:31:32.873095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881697+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:31.881697+0000","last_peered":"2024-04-15T23:31:31.881697+0000","last_clean":"2024-04-15T23:31:31.881697+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:31.881697+0000","last_undegraded":"2024-04-15T23:31:31.881697+0000","last_fullsized":"2024-04-15T23:31:31.881697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881360+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:31.881360+0000","last_peered":"2024-04-15T23:31:31.881360+0000","last_clean":"2024-04-15T23:31:31.881360+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:31.881360+0000","last_undegraded":"2024-04-15T23:31:31.881360+0000","last_fullsized":"2024-04-15T23:31:31.881360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872570+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:32.872570+0000","last_peered":"2024-04-15T23:31:32.872570+0000","last_clean":"2024-04-15T23:31:32.872570+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:32.872570+0000","last_undegraded":"2024-04-15T23:31:32.872570+0000","last_fullsized":"2024-04-15T23:31:32.872570+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872656+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:32.872656+0000","last_peered":"2024-04-15T23:31:32.872656+0000","last_clean":"2024-04-15T23:31:32.872656+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:32.872656+0000","last_undegraded":"2024-04-15T23:31:32.872656+0000","last_fullsized":"2024-04-15T23:31:32.872656+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872467+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:32.872467+0000","last_peered":"2024-04-15T23:31:32.872467+0000","last_clean":"2024-04-15T23:31:32.872467+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:32.872467+0000","last_undegraded":"2024-04-15T23:31:32.872467+0000","last_fullsized":"2024-04-15T23:31:32.872467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869858+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:32.869858+0000","last_peered":"2024-04-15T23:31:32.869858+0000","last_clean":"2024-04-15T23:31:32.869858+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:32.869858+0000","last_undegraded":"2024-04-15T23:31:32.869858+0000","last_fullsized":"2024-04-15T23:31:32.869858+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882220+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:31.882220+0000","last_peered":"2024-04-15T23:31:31.882220+0000","last_clean":"2024-04-15T23:31:31.882220+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:31.882220+0000","last_undegraded":"2024-04-15T23:31:31.882220+0000","last_fullsized":"2024-04-15T23:31:31.882220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869019+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:32.869019+0000","last_peered":"2024-04-15T23:31:32.869019+0000","last_clean":"2024-04-15T23:31:32.869019+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:32.869019+0000","last_undegraded":"2024-04-15T23:31:32.869019+0000","last_fullsized":"2024-04-15T23:31:32.869019+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873131+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:32.873131+0000","last_peered":"2024-04-15T23:31:32.873131+0000","last_clean":"2024-04-15T23:31:32.873131+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:32.873131+0000","last_undegraded":"2024-04-15T23:31:32.873131+0000","last_fullsized":"2024-04-15T23:31:32.873131+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873464+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:32.873464+0000","last_peered":"2024-04-15T23:31:32.873464+0000","last_clean":"2024-04-15T23:31:32.873464+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:32.873464+0000","last_undegraded":"2024-04-15T23:31:32.873464+0000","last_fullsized":"2024-04-15T23:31:32.873464+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881386+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:31.881386+0000","last_peered":"2024-04-15T23:31:31.881386+0000","last_clean":"2024-04-15T23:31:31.881386+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:31.881386+0000","last_undegraded":"2024-04-15T23:31:31.881386+0000","last_fullsized":"2024-04-15T23:31:31.881386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868278+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:32.868278+0000","last_peered":"2024-04-15T23:31:32.868278+0000","last_clean":"2024-04-15T23:31:32.868278+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:32.868278+0000","last_undegraded":"2024-04-15T23:31:32.868278+0000","last_fullsized":"2024-04-15T23:31:32.868278+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.880945+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:31.880945+0000","last_peered":"2024-04-15T23:31:31.880945+0000","last_clean":"2024-04-15T23:31:31.880945+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:31.880945+0000","last_undegraded":"2024-04-15T23:31:31.880945+0000","last_fullsized":"2024-04-15T23:31:31.880945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882304+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:31.882304+0000","last_peered":"2024-04-15T23:31:31.882304+0000","last_clean":"2024-04-15T23:31:31.882304+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:31.882304+0000","last_undegraded":"2024-04-15T23:31:31.882304+0000","last_fullsized":"2024-04-15T23:31:31.882304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869414+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869414+0000","last_peered":"2024-04-15T23:31:32.869414+0000","last_clean":"2024-04-15T23:31:32.869414+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:32.869414+0000","last_undegraded":"2024-04-15T23:31:32.869414+0000","last_fullsized":"2024-04-15T23:31:32.869414+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873492+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:32.873492+0000","last_peered":"2024-04-15T23:31:32.873492+0000","last_clean":"2024-04-15T23:31:32.873492+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:32.873492+0000","last_undegraded":"2024-04-15T23:31:32.873492+0000","last_fullsized":"2024-04-15T23:31:32.873492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881984+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:31.881984+0000","last_peered":"2024-04-15T23:31:31.881984+0000","last_clean":"2024-04-15T23:31:31.881984+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:31.881984+0000","last_undegraded":"2024-04-15T23:31:31.881984+0000","last_fullsized":"2024-04-15T23:31:31.881984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869197+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:32.869197+0000","last_peered":"2024-04-15T23:31:32.869197+0000","last_clean":"2024-04-15T23:31:32.869197+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:32.869197+0000","last_undegraded":"2024-04-15T23:31:32.869197+0000","last_fullsized":"2024-04-15T23:31:32.869197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881682+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:31.881682+0000","last_peered":"2024-04-15T23:31:31.881682+0000","last_clean":"2024-04-15T23:31:31.881682+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:31.881682+0000","last_undegraded":"2024-04-15T23:31:31.881682+0000","last_fullsized":"2024-04-15T23:31:31.881682+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868338+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:32.868338+0000","last_peered":"2024-04-15T23:31:32.868338+0000","last_clean":"2024-04-15T23:31:32.868338+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:32.868338+0000","last_undegraded":"2024-04-15T23:31:32.868338+0000","last_fullsized":"2024-04-15T23:31:32.868338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872437+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:32.872437+0000","last_peered":"2024-04-15T23:31:32.872437+0000","last_clean":"2024-04-15T23:31:32.872437+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:32.872437+0000","last_undegraded":"2024-04-15T23:31:32.872437+0000","last_fullsized":"2024-04-15T23:31:32.872437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881756+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:31.881756+0000","last_peered":"2024-04-15T23:31:31.881756+0000","last_clean":"2024-04-15T23:31:31.881756+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:31.881756+0000","last_undegraded":"2024-04-15T23:31:31.881756+0000","last_fullsized":"2024-04-15T23:31:31.881756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873498+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:32.873498+0000","last_peered":"2024-04-15T23:31:32.873498+0000","last_clean":"2024-04-15T23:31:32.873498+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:32.873498+0000","last_undegraded":"2024-04-15T23:31:32.873498+0000","last_fullsized":"2024-04-15T23:31:32.873498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882157+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:31.882157+0000","last_peered":"2024-04-15T23:31:31.882157+0000","last_clean":"2024-04-15T23:31:31.882157+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:31.882157+0000","last_undegraded":"2024-04-15T23:31:31.882157+0000","last_fullsized":"2024-04-15T23:31:31.882157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868654+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:32.868654+0000","last_peered":"2024-04-15T23:31:32.868654+0000","last_clean":"2024-04-15T23:31:32.868654+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:32.868654+0000","last_undegraded":"2024-04-15T23:31:32.868654+0000","last_fullsized":"2024-04-15T23:31:32.868654+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869537+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:32.869537+0000","last_peered":"2024-04-15T23:31:32.869537+0000","last_clean":"2024-04-15T23:31:32.869537+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:32.869537+0000","last_undegraded":"2024-04-15T23:31:32.869537+0000","last_fullsized":"2024-04-15T23:31:32.869537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881346+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:31.881346+0000","last_peered":"2024-04-15T23:31:31.881346+0000","last_clean":"2024-04-15T23:31:31.881346+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:31.881346+0000","last_undegraded":"2024-04-15T23:31:31.881346+0000","last_fullsized":"2024-04-15T23:31:31.881346+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869351+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:32.869351+0000","last_peered":"2024-04-15T23:31:32.869351+0000","last_clean":"2024-04-15T23:31:32.869351+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:32.869351+0000","last_undegraded":"2024-04-15T23:31:32.869351+0000","last_fullsized":"2024-04-15T23:31:32.869351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872629+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:32.872629+0000","last_peered":"2024-04-15T23:31:32.872629+0000","last_clean":"2024-04-15T23:31:32.872629+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:32.872629+0000","last_undegraded":"2024-04-15T23:31:32.872629+0000","last_fullsized":"2024-04-15T23:31:32.872629+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873206+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:32.873206+0000","last_peered":"2024-04-15T23:31:32.873206+0000","last_clean":"2024-04-15T23:31:32.873206+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:32.873206+0000","last_undegraded":"2024-04-15T23:31:32.873206+0000","last_fullsized":"2024-04-15T23:31:32.873206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881005+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:31.881005+0000","last_peered":"2024-04-15T23:31:31.881005+0000","last_clean":"2024-04-15T23:31:31.881005+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:31.881005+0000","last_undegraded":"2024-04-15T23:31:31.881005+0000","last_fullsized":"2024-04-15T23:31:31.881005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882332+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:31.882332+0000","last_peered":"2024-04-15T23:31:31.882332+0000","last_clean":"2024-04-15T23:31:31.882332+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:31.882332+0000","last_undegraded":"2024-04-15T23:31:31.882332+0000","last_fullsized":"2024-04-15T23:31:31.882332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881199+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:31.881199+0000","last_peered":"2024-04-15T23:31:31.881199+0000","last_clean":"2024-04-15T23:31:31.881199+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:31.881199+0000","last_undegraded":"2024-04-15T23:31:31.881199+0000","last_fullsized":"2024-04-15T23:31:31.881199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873620+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:32.873620+0000","last_peered":"2024-04-15T23:31:32.873620+0000","last_clean":"2024-04-15T23:31:32.873620+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:32.873620+0000","last_undegraded":"2024-04-15T23:31:32.873620+0000","last_fullsized":"2024-04-15T23:31:32.873620+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.872743+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:32.872743+0000","last_peered":"2024-04-15T23:31:32.872743+0000","last_clean":"2024-04-15T23:31:32.872743+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:32.872743+0000","last_undegraded":"2024-04-15T23:31:32.872743+0000","last_fullsized":"2024-04-15T23:31:32.872743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873389+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:32.873389+0000","last_peered":"2024-04-15T23:31:32.873389+0000","last_clean":"2024-04-15T23:31:32.873389+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:32.873389+0000","last_undegraded":"2024-04-15T23:31:32.873389+0000","last_fullsized":"2024-04-15T23:31:32.873389+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868888+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:32.868888+0000","last_peered":"2024-04-15T23:31:32.868888+0000","last_clean":"2024-04-15T23:31:32.868888+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:32.868888+0000","last_undegraded":"2024-04-15T23:31:32.868888+0000","last_fullsized":"2024-04-15T23:31:32.868888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869420+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:32.869420+0000","last_peered":"2024-04-15T23:31:32.869420+0000","last_clean":"2024-04-15T23:31:32.869420+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:32.869420+0000","last_undegraded":"2024-04-15T23:31:32.869420+0000","last_fullsized":"2024-04-15T23:31:32.869420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873238+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:32.873238+0000","last_peered":"2024-04-15T23:31:32.873238+0000","last_clean":"2024-04-15T23:31:32.873238+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:32.873238+0000","last_undegraded":"2024-04-15T23:31:32.873238+0000","last_fullsized":"2024-04-15T23:31:32.873238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873205+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:32.873205+0000","last_peered":"2024-04-15T23:31:32.873205+0000","last_clean":"2024-04-15T23:31:32.873205+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:32.873205+0000","last_undegraded":"2024-04-15T23:31:32.873205+0000","last_fullsized":"2024-04-15T23:31:32.873205+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873417+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:32.873417+0000","last_peered":"2024-04-15T23:31:32.873417+0000","last_clean":"2024-04-15T23:31:32.873417+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:32.873417+0000","last_undegraded":"2024-04-15T23:31:32.873417+0000","last_fullsized":"2024-04-15T23:31:32.873417+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881379+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:31.881379+0000","last_peered":"2024-04-15T23:31:31.881379+0000","last_clean":"2024-04-15T23:31:31.881379+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:31.881379+0000","last_undegraded":"2024-04-15T23:31:31.881379+0000","last_fullsized":"2024-04-15T23:31:31.881379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873159+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:32.873159+0000","last_peered":"2024-04-15T23:31:32.873159+0000","last_clean":"2024-04-15T23:31:32.873159+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:32.873159+0000","last_undegraded":"2024-04-15T23:31:32.873159+0000","last_fullsized":"2024-04-15T23:31:32.873159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881106+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:31.881106+0000","last_peered":"2024-04-15T23:31:31.881106+0000","last_clean":"2024-04-15T23:31:31.881106+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:31.881106+0000","last_undegraded":"2024-04-15T23:31:31.881106+0000","last_fullsized":"2024-04-15T23:31:31.881106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869573+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:32.869573+0000","last_peered":"2024-04-15T23:31:32.869573+0000","last_clean":"2024-04-15T23:31:32.869573+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:32.869573+0000","last_undegraded":"2024-04-15T23:31:32.869573+0000","last_fullsized":"2024-04-15T23:31:32.869573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":216,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873127+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:32.873127+0000","last_peered":"2024-04-15T23:31:32.873127+0000","last_clean":"2024-04-15T23:31:32.873127+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:32.873127+0000","last_undegraded":"2024-04-15T23:31:32.873127+0000","last_fullsized":"2024-04-15T23:31:32.873127+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873569+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:32.873569+0000","last_peered":"2024-04-15T23:31:32.873569+0000","last_clean":"2024-04-15T23:31:32.873569+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:32.873569+0000","last_undegraded":"2024-04-15T23:31:32.873569+0000","last_fullsized":"2024-04-15T23:31:32.873569+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868860+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:32.868860+0000","last_peered":"2024-04-15T23:31:32.868860+0000","last_clean":"2024-04-15T23:31:32.868860+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:32.868860+0000","last_undegraded":"2024-04-15T23:31:32.868860+0000","last_fullsized":"2024-04-15T23:31:32.868860+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873528+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:32.873528+0000","last_peered":"2024-04-15T23:31:32.873528+0000","last_clean":"2024-04-15T23:31:32.873528+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:32.873528+0000","last_undegraded":"2024-04-15T23:31:32.873528+0000","last_fullsized":"2024-04-15T23:31:32.873528+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873011+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:32.873011+0000","last_peered":"2024-04-15T23:31:32.873011+0000","last_clean":"2024-04-15T23:31:32.873011+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:32.873011+0000","last_undegraded":"2024-04-15T23:31:32.873011+0000","last_fullsized":"2024-04-15T23:31:32.873011+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868778+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:32.868778+0000","last_peered":"2024-04-15T23:31:32.868778+0000","last_clean":"2024-04-15T23:31:32.868778+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:32.868778+0000","last_undegraded":"2024-04-15T23:31:32.868778+0000","last_fullsized":"2024-04-15T23:31:32.868778+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882190+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:31.882190+0000","last_peered":"2024-04-15T23:31:31.882190+0000","last_clean":"2024-04-15T23:31:31.882190+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:31.882190+0000","last_undegraded":"2024-04-15T23:31:31.882190+0000","last_fullsized":"2024-04-15T23:31:31.882190+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868848+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:32.868848+0000","last_peered":"2024-04-15T23:31:32.868848+0000","last_clean":"2024-04-15T23:31:32.868848+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:32.868848+0000","last_undegraded":"2024-04-15T23:31:32.868848+0000","last_fullsized":"2024-04-15T23:31:32.868848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881242+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:31.881242+0000","last_peered":"2024-04-15T23:31:31.881242+0000","last_clean":"2024-04-15T23:31:31.881242+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:31.881242+0000","last_undegraded":"2024-04-15T23:31:31.881242+0000","last_fullsized":"2024-04-15T23:31:31.881242+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869567+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:32.869567+0000","last_peered":"2024-04-15T23:31:32.869567+0000","last_clean":"2024-04-15T23:31:32.869567+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:32.869567+0000","last_undegraded":"2024-04-15T23:31:32.869567+0000","last_fullsized":"2024-04-15T23:31:32.869567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873279+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:32.873279+0000","last_peered":"2024-04-15T23:31:32.873279+0000","last_clean":"2024-04-15T23:31:32.873279+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:32.873279+0000","last_undegraded":"2024-04-15T23:31:32.873279+0000","last_fullsized":"2024-04-15T23:31:32.873279+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873547+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:32.873547+0000","last_peered":"2024-04-15T23:31:32.873547+0000","last_clean":"2024-04-15T23:31:32.873547+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:32.873547+0000","last_undegraded":"2024-04-15T23:31:32.873547+0000","last_fullsized":"2024-04-15T23:31:32.873547+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869117+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:32.869117+0000","last_peered":"2024-04-15T23:31:32.869117+0000","last_clean":"2024-04-15T23:31:32.869117+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:32.869117+0000","last_undegraded":"2024-04-15T23:31:32.869117+0000","last_fullsized":"2024-04-15T23:31:32.869117+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873596+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:32.873596+0000","last_peered":"2024-04-15T23:31:32.873596+0000","last_clean":"2024-04-15T23:31:32.873596+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:32.873596+0000","last_undegraded":"2024-04-15T23:31:32.873596+0000","last_fullsized":"2024-04-15T23:31:32.873596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869211+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:32.869211+0000","last_peered":"2024-04-15T23:31:32.869211+0000","last_clean":"2024-04-15T23:31:32.869211+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:32.869211+0000","last_undegraded":"2024-04-15T23:31:32.869211+0000","last_fullsized":"2024-04-15T23:31:32.869211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881418+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:31.881418+0000","last_peered":"2024-04-15T23:31:31.881418+0000","last_clean":"2024-04-15T23:31:31.881418+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:31.881418+0000","last_undegraded":"2024-04-15T23:31:31.881418+0000","last_fullsized":"2024-04-15T23:31:31.881418+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869239+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:32.869239+0000","last_peered":"2024-04-15T23:31:32.869239+0000","last_clean":"2024-04-15T23:31:32.869239+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:32.869239+0000","last_undegraded":"2024-04-15T23:31:32.869239+0000","last_fullsized":"2024-04-15T23:31:32.869239+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882374+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:31.882374+0000","last_peered":"2024-04-15T23:31:31.882374+0000","last_clean":"2024-04-15T23:31:31.882374+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:31.882374+0000","last_undegraded":"2024-04-15T23:31:31.882374+0000","last_fullsized":"2024-04-15T23:31:31.882374+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881543+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:31.881543+0000","last_peered":"2024-04-15T23:31:31.881543+0000","last_clean":"2024-04-15T23:31:31.881543+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:31.881543+0000","last_undegraded":"2024-04-15T23:31:31.881543+0000","last_fullsized":"2024-04-15T23:31:31.881543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869884+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:32.869884+0000","last_peered":"2024-04-15T23:31:32.869884+0000","last_clean":"2024-04-15T23:31:32.869884+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:32.869884+0000","last_undegraded":"2024-04-15T23:31:32.869884+0000","last_fullsized":"2024-04-15T23:31:32.869884+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869595+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:32.869595+0000","last_peered":"2024-04-15T23:31:32.869595+0000","last_clean":"2024-04-15T23:31:32.869595+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:32.869595+0000","last_undegraded":"2024-04-15T23:31:32.869595+0000","last_fullsized":"2024-04-15T23:31:32.869595+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868519+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:32.868519+0000","last_peered":"2024-04-15T23:31:32.868519+0000","last_clean":"2024-04-15T23:31:32.868519+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:32.868519+0000","last_undegraded":"2024-04-15T23:31:32.868519+0000","last_fullsized":"2024-04-15T23:31:32.868519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"15'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.871245+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:32.871245+0000","last_peered":"2024-04-15T23:31:32.871245+0000","last_clean":"2024-04-15T23:31:32.871245+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:32.871245+0000","last_undegraded":"2024-04-15T23:31:32.871245+0000","last_fullsized":"2024-04-15T23:31:32.871245+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873285+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:32.873285+0000","last_peered":"2024-04-15T23:31:32.873285+0000","last_clean":"2024-04-15T23:31:32.873285+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:32.873285+0000","last_undegraded":"2024-04-15T23:31:32.873285+0000","last_fullsized":"2024-04-15T23:31:32.873285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881196+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:31.881196+0000","last_peered":"2024-04-15T23:31:31.881196+0000","last_clean":"2024-04-15T23:31:31.881196+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:31.881196+0000","last_undegraded":"2024-04-15T23:31:31.881196+0000","last_fullsized":"2024-04-15T23:31:31.881196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873078+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:32.873078+0000","last_peered":"2024-04-15T23:31:32.873078+0000","last_clean":"2024-04-15T23:31:32.873078+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:32.873078+0000","last_undegraded":"2024-04-15T23:31:32.873078+0000","last_fullsized":"2024-04-15T23:31:32.873078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"14'6","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873349+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:32.873349+0000","last_peered":"2024-04-15T23:31:32.873349+0000","last_clean":"2024-04-15T23:31:32.873349+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:32.873349+0000","last_undegraded":"2024-04-15T23:31:32.873349+0000","last_fullsized":"2024-04-15T23:31:32.873349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868520+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:32.868520+0000","last_peered":"2024-04-15T23:31:32.868520+0000","last_clean":"2024-04-15T23:31:32.868520+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:32.868520+0000","last_undegraded":"2024-04-15T23:31:32.868520+0000","last_fullsized":"2024-04-15T23:31:32.868520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882316+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:31.882316+0000","last_peered":"2024-04-15T23:31:31.882316+0000","last_clean":"2024-04-15T23:31:31.882316+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:31.882316+0000","last_undegraded":"2024-04-15T23:31:31.882316+0000","last_fullsized":"2024-04-15T23:31:31.882316+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873151+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:32.873151+0000","last_peered":"2024-04-15T23:31:32.873151+0000","last_clean":"2024-04-15T23:31:32.873151+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:32.873151+0000","last_undegraded":"2024-04-15T23:31:32.873151+0000","last_fullsized":"2024-04-15T23:31:32.873151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868637+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:32.868637+0000","last_peered":"2024-04-15T23:31:32.868637+0000","last_clean":"2024-04-15T23:31:32.868637+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:32.868637+0000","last_undegraded":"2024-04-15T23:31:32.868637+0000","last_fullsized":"2024-04-15T23:31:32.868637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869780+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:32.869780+0000","last_peered":"2024-04-15T23:31:32.869780+0000","last_clean":"2024-04-15T23:31:32.869780+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:32.869780+0000","last_undegraded":"2024-04-15T23:31:32.869780+0000","last_fullsized":"2024-04-15T23:31:32.869780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868441+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:32.868441+0000","last_peered":"2024-04-15T23:31:32.868441+0000","last_clean":"2024-04-15T23:31:32.868441+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:32.868441+0000","last_undegraded":"2024-04-15T23:31:32.868441+0000","last_fullsized":"2024-04-15T23:31:32.868441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882405+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:31.882405+0000","last_peered":"2024-04-15T23:31:31.882405+0000","last_clean":"2024-04-15T23:31:31.882405+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:31.882405+0000","last_undegraded":"2024-04-15T23:31:31.882405+0000","last_fullsized":"2024-04-15T23:31:31.882405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868560+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:32.868560+0000","last_peered":"2024-04-15T23:31:32.868560+0000","last_clean":"2024-04-15T23:31:32.868560+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:32.868560+0000","last_undegraded":"2024-04-15T23:31:32.868560+0000","last_fullsized":"2024-04-15T23:31:32.868560+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869302+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:32.869302+0000","last_peered":"2024-04-15T23:31:32.869302+0000","last_clean":"2024-04-15T23:31:32.869302+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:32.869302+0000","last_undegraded":"2024-04-15T23:31:32.869302+0000","last_fullsized":"2024-04-15T23:31:32.869302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.868627+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:32.868627+0000","last_peered":"2024-04-15T23:31:32.868627+0000","last_clean":"2024-04-15T23:31:32.868627+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:32.868627+0000","last_undegraded":"2024-04-15T23:31:32.868627+0000","last_fullsized":"2024-04-15T23:31:32.868627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882022+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:31.882022+0000","last_peered":"2024-04-15T23:31:31.882022+0000","last_clean":"2024-04-15T23:31:31.882022+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:31.882022+0000","last_undegraded":"2024-04-15T23:31:31.882022+0000","last_fullsized":"2024-04-15T23:31:31.882022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881588+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:31.881588+0000","last_peered":"2024-04-15T23:31:31.881588+0000","last_clean":"2024-04-15T23:31:31.881588+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:31.881588+0000","last_undegraded":"2024-04-15T23:31:31.881588+0000","last_fullsized":"2024-04-15T23:31:31.881588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881564+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:31.881564+0000","last_peered":"2024-04-15T23:31:31.881564+0000","last_clean":"2024-04-15T23:31:31.881564+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:31.881564+0000","last_undegraded":"2024-04-15T23:31:31.881564+0000","last_fullsized":"2024-04-15T23:31:31.881564+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881687+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:31.881687+0000","last_peered":"2024-04-15T23:31:31.881687+0000","last_clean":"2024-04-15T23:31:31.881687+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:31.881687+0000","last_undegraded":"2024-04-15T23:31:31.881687+0000","last_fullsized":"2024-04-15T23:31:31.881687+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873275+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:32.873275+0000","last_peered":"2024-04-15T23:31:32.873275+0000","last_clean":"2024-04-15T23:31:32.873275+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:32.873275+0000","last_undegraded":"2024-04-15T23:31:32.873275+0000","last_fullsized":"2024-04-15T23:31:32.873275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873266+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:32.873266+0000","last_peered":"2024-04-15T23:31:32.873266+0000","last_clean":"2024-04-15T23:31:32.873266+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:32.873266+0000","last_undegraded":"2024-04-15T23:31:32.873266+0000","last_fullsized":"2024-04-15T23:31:32.873266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873207+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:32.873207+0000","last_peered":"2024-04-15T23:31:32.873207+0000","last_clean":"2024-04-15T23:31:32.873207+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:32.873207+0000","last_undegraded":"2024-04-15T23:31:32.873207+0000","last_fullsized":"2024-04-15T23:31:32.873207+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.882153+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:31.882153+0000","last_peered":"2024-04-15T23:31:31.882153+0000","last_clean":"2024-04-15T23:31:31.882153+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:31.882153+0000","last_undegraded":"2024-04-15T23:31:31.882153+0000","last_fullsized":"2024-04-15T23:31:31.882153+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:31.881611+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:31.881611+0000","last_peered":"2024-04-15T23:31:31.881611+0000","last_clean":"2024-04-15T23:31:31.881611+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:31.881611+0000","last_undegraded":"2024-04-15T23:31:31.881611+0000","last_fullsized":"2024-04-15T23:31:31.881611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869520+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:32.869520+0000","last_peered":"2024-04-15T23:31:32.869520+0000","last_clean":"2024-04-15T23:31:32.869520+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:32.869520+0000","last_undegraded":"2024-04-15T23:31:32.869520+0000","last_fullsized":"2024-04-15T23:31:32.869520+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.873123+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:32.873123+0000","last_peered":"2024-04-15T23:31:32.873123+0000","last_clean":"2024-04-15T23:31:32.873123+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:32.873123+0000","last_undegraded":"2024-04-15T23:31:32.873123+0000","last_fullsized":"2024-04-15T23:31:32.873123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-15T23:31:32.869698+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:32.869698+0000","last_peered":"2024-04-15T23:31:32.869698+0000","last_clean":"2024-04-15T23:31:32.869698+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:32.869698+0000","last_undegraded":"2024-04-15T23:31:32.869698+0000","last_fullsized":"2024-04-15T23:31:32.869698+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":139264,"data_stored":46699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":757760,"data_stored":638861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":638245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:31:54.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:54.591 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:54.607+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:54.655 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.655 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.664 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:54.708 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:54.725+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:54.784 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.784 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.785 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:54.800+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:54.794 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:54.886 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:54.903+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:54.944 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:54.944 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:54.952 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:54.988 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:55.003+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:55.060 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:55.060 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:55.069 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:55.113 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:55.130+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:55.179 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:55.188 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:55.229 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:55.245+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:55.290 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:55.306+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:55.336 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:55.337 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:55.345 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:55.391 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:55.407+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:55.445 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:31:55.449 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:31:55.453 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:55.453 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:55.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:55.507 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:55.523+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:55.575 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:55.576 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:55.579 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:31:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:31:55.585 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:55.592 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:55.609+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:55.597 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:31:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:31:55.614 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:31:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:31:55.693 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:55.708+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:55.734 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:31:55.734 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:31:55.734 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:55.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:55.794 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:55.811+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:55.893 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:55.894 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 29.839748027999999, 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:55.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:31:55.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:31:55.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:55.900 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 29.83966654, 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:31:55.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041574849, 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.906 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.908 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.911 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041526859000001, 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:31:55.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:31:55.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:31:55.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:31:55.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041488560000001, 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:31:55.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:31:55.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:31:55.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041449772, 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:31:55.922 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.927 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041426440999999, 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041395955999999, 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:31:55.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:31:55.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:31:55.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.937 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041360887, 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:31:55.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041337144, 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.943 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041312885, 2024-04-15T23:31:55.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:31:55.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:31:55.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:31:55.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.953 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041284546, 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:31:55.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:31:55.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041245747000001, 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.963 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041210576000001, 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:55.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:31:55.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:31:55.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:31:55.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:31:55.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041177208000001, 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:31:55.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:31:55.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:31:55.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.041119747, 2024-04-15T23:31:55.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.979 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.039484087000002, 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.038592555000001, 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:31:55.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:31:55.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:31:55.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:31:55.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.038541207000002, 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:31:55.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:31:55.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.038503090999999, 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:55.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.998 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.999 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:55.999 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:55.999 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:56.000 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:56.016+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:56.000 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:56.101 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:56.117+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:56.120 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:56.120 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:31:56.120 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:31:56.120 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:56.129 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:56.201 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:56.218+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:56.238 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:56.238 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:31:56.238 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-15T23:31:56.238 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-15T23:31:56.238 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:56.247 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:56.302 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:56.319+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:56.358 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:56.358 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.505914318999999, 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016751775999999999, 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.359 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.360 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867736+0000", 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2537999999999999e-05 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867743+0000", 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4279999999999999e-06 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867756+0000", 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2774e-05 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.361 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867783+0000", 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7722e-05 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868423+0000", 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00063940899999999996 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868430+0000", 2024-04-15T23:31:56.362 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7880000000000001e-06 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876493+0000", 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0080637980000000005 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876624+0000", 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013080599999999999 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877204+0000", 2024-04-15T23:31:56.363 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057935099999999998 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881649+0000", 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044450940000000001 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884341+0000", 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026923139999999999 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.364 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884405+0000", 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4220999999999994e-05 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884475+0000", 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9533e-05 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:7 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.505299638, 2024-04-15T23:31:56.365 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016252260000000001, 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.366 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6000000000000002e-07 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868345+0000", 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0580000000000003e-06 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868354+0000", 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6059999999999992e-06 2024-04-15T23:31:56.367 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868362+0000", 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1429999999999998e-06 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868677+0000", 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000314383 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868684+0000", 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4320000000000002e-06 2024-04-15T23:31:56.368 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877636+0000", 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0089513189999999992 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877748+0000", 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111993 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877866+0000", 2024-04-15T23:31:56.369 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000118721 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881773+0000", 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039063989999999996 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884521+0000", 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027486450000000001 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.370 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884558+0000", 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6371000000000001e-05 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884590+0000", 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2329999999999997e-05 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.371 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.505223378, 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013223400999999999, 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.372 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868415+0000", 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0500000000000003e-07 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868427+0000", 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.201e-05 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.373 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868435+0000", 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1920000000000005e-06 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868445+0000", 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9909999999999997e-06 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868650+0000", 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00020519700000000001 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.374 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868657+0000", 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5060000000000001e-06 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875798+0000", 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007141072 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876016+0000", 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000218316 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876164+0000", 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014811300000000001 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880696+0000", 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045315370000000004 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881556+0000", 2024-04-15T23:31:56.376 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086031699999999998 2024-04-15T23:31:56.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.377 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.377 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.377 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881600+0000", 2024-04-15T23:31:56.377 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4335000000000002e-05 2024-04-15T23:31:56.377 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881637+0000", 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7110000000000002e-05 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.505181811, 2024-04-15T23:31:56.378 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013308986, 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.379 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4099999999999998e-07 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868460+0000", 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2740000000000001e-06 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868467+0000", 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3899999999999998e-06 2024-04-15T23:31:56.380 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868479+0000", 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1951e-05 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868711+0000", 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000232465 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868715+0000", 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1860000000000002e-06 2024-04-15T23:31:56.381 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876682+0000", 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079668489999999998 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876769+0000", 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6967999999999998e-05 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877143+0000", 2024-04-15T23:31:56.382 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00037359300000000003 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880775+0000", 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036317979999999999 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881652+0000", 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00087763100000000003 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881715+0000", 2024-04-15T23:31:56.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2788999999999998e-05 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881765+0000", 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450999999999998e-05 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.505091670999999, 2024-04-15T23:31:56.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016167357, 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:31:56.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868547+0000", 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2999999999999999e-07 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868551+0000", 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.848e-06 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868567+0000", 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.5319999999999999e-05 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868575+0000", 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8790000000000003e-06 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017436900000000001 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868761+0000", 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.182e-05 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878325+0000", 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0095639330000000002 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878481+0000", 2024-04-15T23:31:56.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015608399999999999 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878620+0000", 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000139288 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881779+0000", 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031593540000000001 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884634+0000", 2024-04-15T23:31:56.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0028545049999999998 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884674+0000", 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9878e-05 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884713+0000", 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9249000000000003e-05 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.505039693000001, 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015469673, 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8100000000000002e-07 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868603+0000", 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6770000000000003e-06 2024-04-15T23:31:56.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868613+0000", 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5699999999999999e-06 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868620+0000", 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2830000000000004e-06 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869826+0000", 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0012064339999999999 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869832+0000", 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0290000000000002e-06 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874065+0000", 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0042329510000000004 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874220+0000", 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015491699999999999 2024-04-15T23:31:56.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874405+0000", 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018499599999999999 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879828+0000", 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0054231410000000002 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883969+0000", 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041404559999999998 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884024+0000", 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4944000000000001e-05 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884067+0000", 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3494000000000001e-05 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.396 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.504701018999999, 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015273920999999999, 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868937+0000", 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.47e-07 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868947+0000", 2024-04-15T23:31:56.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6730000000000004e-06 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868959+0000", 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1956999999999999e-05 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868968+0000", 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.3009999999999995e-06 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869942+0000", 2024-04-15T23:31:56.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00097338899999999996 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869946+0000", 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7550000000000002e-06 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875078+0000", 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051312529999999997 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000148949 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884210+0000", 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008983797 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.503783395999999, 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014939332, 2024-04-15T23:31:56.401 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869855+0000", 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9599999999999998e-07 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869860+0000", 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9779999999999996e-06 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869871+0000", 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1032e-05 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869880+0000", 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9600000000000006e-06 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869979+0000", 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9392e-05 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869983+0000", 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6380000000000002e-06 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879365+0000", 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093823139999999992 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879554+0000", 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018925300000000001 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884793+0000", 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052388690000000002 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.405 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.503737736000001, 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.01118678, 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8599999999999998e-07 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869903+0000", 2024-04-15T23:31:56.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9979999999999999e-06 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869999+0000", 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5710000000000004e-05 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870008+0000", 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1600000000000004e-06 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870654+0000", 2024-04-15T23:31:56.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00064568299999999998 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870660+0000", 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0769999999999996e-06 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876226+0000", 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055662949999999997 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876342+0000", 2024-04-15T23:31:56.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011568700000000001 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881086+0000", 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0047445839999999996 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.503028764, 2024-04-15T23:31:56.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.006624909, 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7399999999999999e-07 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870622+0000", 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2914e-05 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870653+0000", 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0806000000000003e-05 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870670+0000", 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.694e-05 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.872456+0000", 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017861940000000001 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877234+0000", 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004777781 2024-04-15T23:31:56.413 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.499960388000002, 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0058784350000000004, 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.67e-07 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873697+0000", 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9491999999999999e-05 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873708+0000", 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0893999999999999e-05 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873726+0000", 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7999000000000002e-05 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873911+0000", 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018578600000000001 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873936+0000", 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4454999999999999e-05 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879501+0000", 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055647470000000001 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879555+0000", 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4795e-05 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.496166805000001, 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037213989999999998, 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.418 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:31:56.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877477+0000", 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3319999999999997e-06 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877486+0000", 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0550000000000005e-06 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877505+0000", 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8844000000000001e-05 2024-04-15T23:31:56.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877620+0000", 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114393 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877639+0000", 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8788e-05 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881149+0000", 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003510862 2024-04-15T23:31:56.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881192+0000", 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2571000000000003e-05 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.496117632000001, 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037611580000000001, 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.422 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:31:56.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.72e-07 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877531+0000", 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.075e-05 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877540+0000", 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8680000000000005e-06 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877547+0000", 2024-04-15T23:31:56.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.3839999999999999e-06 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877942+0000", 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00039470199999999998 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877960+0000", 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8241999999999999e-05 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881250+0000", 2024-04-15T23:31:56.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032902949999999999 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881281+0000", 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0545e-05 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.496080102000001, 2024-04-15T23:31:56.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037922429999999998, 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877558+0000", 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1899999999999998e-07 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877564+0000", 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5409999999999997e-06 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877572+0000", 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5549999999999997e-06 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877579+0000", 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8190000000000003e-06 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877735+0000", 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000156133 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877754+0000", 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9559e-05 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881307+0000", 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00355296 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881349+0000", 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2256999999999999e-05 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.430 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 3 lcod 14'1)", 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.493295732, 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00023478400000000001, 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2799999999999996e-07 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880346+0000", 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4359999999999998e-06 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880461+0000", 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011513700000000001 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880470+0000", 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7900000000000005e-06 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880527+0000", 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7095999999999997e-05 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880576+0000", 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9796999999999998e-05 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.489712672, 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029033999999999999, 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9400000000000001e-07 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883929+0000", 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9890000000000003e-06 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883938+0000", 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4640000000000006e-06 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883944+0000", 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8870000000000003e-06 2024-04-15T23:31:56.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884099+0000", 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015466199999999999 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884215+0000", 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115944 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.437 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:7 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.489337723999999, 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029787699999999999, 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9099999999999999e-07 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884303+0000", 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1240000000000001e-06 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884310+0000", 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1330000000000001e-06 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884317+0000", 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9920000000000001e-06 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884512+0000", 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00019436900000000001 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884518+0000", 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1770000000000003e-06 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884598+0000", 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9691000000000007e-05 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:56.441 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 25.489252642, 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033810099999999999, 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2600000000000002e-07 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884389+0000", 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8449999999999996e-06 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884398+0000", 2024-04-15T23:31:56.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884404+0000", 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0780000000000001e-06 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884623+0000", 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00021912599999999999 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884630+0000", 2024-04-15T23:31:56.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9419999999999998e-06 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884723+0000", 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2597999999999997e-05 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 23.507574777999999, 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052092120000000004, 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.445 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866064+0000", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.813e-06 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866072+0000", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866085+0000", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3179e-05 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866091+0000", 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0809999999999999e-06 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866178+0000", 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6945000000000002e-05 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866183+0000", 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4710000000000001e-06 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869710+0000", 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0035276610000000001 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869800+0000", 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0153000000000002e-05 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869885+0000", 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4478e-05 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.870362+0000", 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047698899999999998 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871210+0000", 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00084789999999999996 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871244+0000", 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4561999999999999e-05 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871272+0000", 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7461999999999999e-05 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 4.5055492609999996, 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001586395, 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:31:56.451 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:31:56.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868089+0000", 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1710000000000001e-06 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868098+0000", 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868115+0000", 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6843000000000001e-05 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868143+0000", 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7512e-05 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868212+0000", 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9487999999999996e-05 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868288+0000", 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5629000000000004e-05 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868389+0000", 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100985 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869162+0000", 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00077331800000000005 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869608+0000", 2024-04-15T23:31:56.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00044655299999999998 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869642+0000", 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4010000000000001e-05 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869674+0000", 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1999999999999999e-05 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:31:56.456 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:31:56.457 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:56.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:56.459 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:56.474+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:56.559 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:56.576+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:56.578 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:56.578 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:56.578 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:31:56.578 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:56.588 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:56.660 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:56.677+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:56.696 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:56.697 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:31:56.697 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:31:56.697 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:31:56.697 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:56.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:56.761 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:56.777+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:56.815 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:31:56.815 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:31:56.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:31:56.815 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.758968406000001, 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:31:56.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:31:56.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.820 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.758275862000001, 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:31:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.757883948, 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:31:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:31:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:31:56.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.757549503, 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.75625415, 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:31:56.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:31:56.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:31:56.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:56.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.403988287000001, 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:31:56.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.403765284999999, 2024-04-15T23:31:56.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:31:56.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:31:56.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:56.851 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.403324441999999, 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:31:56.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.856 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.402672485, 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:31:56.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:31:56.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.401866217999999, 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:31:56.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.399765724000002, 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.867 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:31:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.962301646, 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:31:56.872 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:31:56.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.878 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.962244901999998, 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:31:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:31:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:31:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.962133745999999, 2024-04-15T23:31:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:31:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.962046732000001, 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:31:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.962013031000001, 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:31:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:31:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:31:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.961824492000002, 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:31:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.961780273999999, 2024-04-15T23:31:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:31:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.961739775000002, 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:31:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.961698065, 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:31:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:31:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:31:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:31:56.929 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:31:56.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:56.931 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:56.946+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:57.033 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:57.047+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:57.051 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:57.051 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:57.051 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:31:57.051 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:57.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:57.132 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:57.148+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:57.169 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:57.169 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:31:57.169 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:31:57.169 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:31:57.169 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:57.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:57.232 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:57.249+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:57.288 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:31:57.288 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 31.234265529000002, 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:31:57.289 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:31:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 31.234184040999999, 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.295 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:31:57.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:31:57.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.436092349999999, 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.301 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:31:57.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.43604436, 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:31:57.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:31:57.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:31:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.436006061, 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:31:57.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.318 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435967272999999, 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:31:57.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:31:57.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435943942000002, 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.324 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:31:57.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:31:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:31:57.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:31:57.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435913457000002, 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.331 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.336 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435878387999999, 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:57.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:31:57.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:31:57.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:31:57.345 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435854644999999, 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:31:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435830385999999, 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.351 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435802046999999, 2024-04-15T23:31:57.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:31:57.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435763248000001, 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.362 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.367 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435728077, 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435694709, 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:31:57.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.435637247999999, 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.378 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:31:57.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:31:57.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:31:57.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:31:57.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.434001588000001, 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.383 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:31:57.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:31:57.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:31:57.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.433110056, 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:31:57.393 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.433058708000001, 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:31:57.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:31:57.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:31:57.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:31:57.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 26.433020591999998, 2024-04-15T23:31:57.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:31:57.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:31:57.403 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:31:57.405 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:57.405 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:57.421+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:57.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:31:57.506 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:57.522+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:57.516 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:57.516 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:31:57.516 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:31:57.516 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:57.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:57.606 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:57.622+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:57.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:31:57.675 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:31:57.675 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:31:57.675 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-15T23:31:57.676 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-15T23:31:57.676 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:31:57.684 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:57.707 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:57.723+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:57.753 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:31:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:31:57.771 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:31:57.771 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:31:57.788 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:31:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:31:57.793 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:57.794 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:57.803 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:57.807 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:57.824+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:57.908 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:57.925+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:57.921 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:57.921 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:57.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:58.009 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:58.026+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:58.040 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.040 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.050 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:58.111 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:58.127+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:58.159 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.159 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:58.212 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:58.229+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:58.282 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.282 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:58.313 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:58.329+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:58.399 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.399 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:58.413 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:58.430+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:58.460 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:31:58.514 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:58.531+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:58.515 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.515 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.524 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:58.616 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:58.632+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:58.638 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.638 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.647 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:58.717 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:58.734+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:58.755 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.756 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.764 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:58.819 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:58.835+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:58.872 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.872 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:58.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:31:58.924 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:58.941+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:58.992 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:58.992 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:31:59.043 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:59.059+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:59.122 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:59.139+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:59.150 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.150 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.159 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:31:59.244 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:59.261+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:59.309 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.310 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:31:59.324 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:59.341+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:59.425 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:59.441+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:59.438 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.438 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:31:59.526 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:59.543+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:59.547 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-15T23:31:59.547 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:31:59.547 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-15T23:31:59.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-15T23:31:59.555 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.555 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:31:59.627 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:59.644+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:59.673 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.673 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.683 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:31:59.728 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:31:59.745+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:31:59.794 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.795 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:31:59.803 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:31:59.829 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:31:59.846+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:31:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:31:59.848 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:31:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 19, 2024-04-15T23:31:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-04-15T23:31:15.484738+0000", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-04-15T23:31:58.469520+0000", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-04-15T23:31:23.575432+0000", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-04-15T23:31:16.326489+0000", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5799936, 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-04-15T23:31:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 4, 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 4, 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 3, 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-04-15T23:31:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "jewel", 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.797113+0000", 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-04-15T23:31:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-04-15T23:31:59.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-04-15T23:31:59.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-04-15T23:31:59.853 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-04-15T23:31:59.853 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:59.853 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:59.853 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:59.854 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:59.855 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:59.857 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-04-15T23:31:59.858 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.948719+0000", 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:59.859 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:59.860 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:59.861 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:59.862 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:59.863 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.5, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.5, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 1, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.5, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.5, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_metadata", 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:28.382708+0000", 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:59.865 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:59.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "14", 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:59.867 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:59.868 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:59.869 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_bias": 4, 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 16, 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_priority": 5 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": "cephfs" 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.1299999952316284, 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.1299999952316284, 2024-04-15T23:31:59.870 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 1, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 4, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_data", 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:29.186157+0000", 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:31:59.871 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 64, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 64, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 64, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 64, 2024-04-15T23:31:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 64, 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "15", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:31:59.873 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:31:59.874 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:31:59.875 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 64, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "target_size_ratio": 0.89999997615814209 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "data": "cephfs" 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.876 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.1299999952316284, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.1299999952316284, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 1, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.877 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "37ee61ed-86ab-4308-a161-cd2aafcfd4f9", 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.878 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6800", 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6801", 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6802", 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6803", 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.880 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6806", 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6807", 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.881 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6804", 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6805", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.107:6801/1269237815", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.107:6803/1269237815", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.107:6807/1269237815", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.107:6805/1269237815", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.883 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "9631dded-d96a-40ad-945d-252291b498da", 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:31:59.884 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6800", 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6801", 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:31:59.885 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6802", 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6803", 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:31:59.886 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6806", 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6807", 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.887 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.888 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6804", 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6805", 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.115:6801/1544615186", 2024-04-15T23:31:59.890 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.115:6803/1544615186", 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.115:6807/1544615186", 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.115:6805/1544615186", 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "45415c3c-3208-4cab-b6d2-75f250746bef", 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:31:59.891 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6800", 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6801", 2024-04-15T23:31:59.892 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6802", 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6803", 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.893 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6806", 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6807", 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.894 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6804", 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6805", 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.895 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.195:6801/2023242123", 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.195:6803/2023242123", 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.195:6807/2023242123", 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.195:6805/2023242123", 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:31:59.896 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.385592+0000", 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.370073+0000", 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:31:59.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.369726+0000", 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [], 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-04-15T23:31:59.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-04-15T23:31:59.899 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:31:59.900 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:31:59.902 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': '60f632e8-f087-41df-a0b6-043b99131bd6', 'created': '2024-04-15T23:31:15.484738+0000', 'modified': '2024-04-15T23:31:58.469520+0000', 'last_up_change': '2024-04-15T23:31:23.575432+0000', 'last_in_change': '2024-04-15T23:31:16.326489+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 1269237815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 1269237815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 1269237815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 1269237815}]}, 'public_addr': '172.21.15.107:6801/1269237815', 'cluster_addr': '172.21.15.107:6803/1269237815', 'heartbeat_back_addr': '172.21.15.107:6807/1269237815', 'heartbeat_front_addr': '172.21.15.107:6805/1269237815', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9631dded-d96a-40ad-945d-252291b498da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 1544615186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 1544615186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 1544615186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 1544615186}]}, 'public_addr': '172.21.15.115:6801/1544615186', 'cluster_addr': '172.21.15.115:6803/1544615186', 'heartbeat_back_addr': '172.21.15.115:6807/1544615186', 'heartbeat_front_addr': '172.21.15.115:6805/1544615186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '45415c3c-3208-4cab-b6d2-75f250746bef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 2023242123}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 2023242123}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 2023242123}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 2023242123}]}, 'public_addr': '172.21.15.195:6801/2023242123', 'cluster_addr': '172.21.15.195:6803/2023242123', 'heartbeat_back_addr': '172.21.15.195:6807/2023242123', 'heartbeat_front_addr': '172.21.15.195:6805/2023242123', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.385592+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.370073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.369726+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-15T23:31:59.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:31:59.910 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:31:59.910 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:31:59.919 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:31:59.928 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:31:59.928 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:31:59.947 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:31:59.947 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:31:59.962 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:31:59.979+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:31:59.964 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:31:59.965 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:32:00.029 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-15T23:32:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-15T23:32:00.029 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.177208489000002, 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016751775999999999, 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:00.030 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867736+0000", 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2537999999999999e-05 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.031 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867743+0000", 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4279999999999999e-06 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867756+0000", 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2774e-05 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867783+0000", 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7722e-05 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.032 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868423+0000", 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00063940899999999996 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868430+0000", 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7880000000000001e-06 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876493+0000", 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0080637980000000005 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.033 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876624+0000", 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013080599999999999 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877204+0000", 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057935099999999998 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881649+0000", 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044450940000000001 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.034 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884341+0000", 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026923139999999999 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884405+0000", 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4220999999999994e-05 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.035 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884475+0000", 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9533e-05 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:7 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.176593808, 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016252260000000001, 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.036 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:00.037 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6000000000000002e-07 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868345+0000", 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0580000000000003e-06 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868354+0000", 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6059999999999992e-06 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.038 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868362+0000", 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1429999999999998e-06 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868677+0000", 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000314383 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868684+0000", 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4320000000000002e-06 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.039 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877636+0000", 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0089513189999999992 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877748+0000", 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111993 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.040 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877866+0000", 2024-04-15T23:32:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000118721 2024-04-15T23:32:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.041 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881773+0000", 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039063989999999996 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884521+0000", 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027486450000000001 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884558+0000", 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6371000000000001e-05 2024-04-15T23:32:00.042 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884590+0000", 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2329999999999997e-05 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.176517548, 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013223400999999999, 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.043 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.044 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868415+0000", 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0500000000000003e-07 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868427+0000", 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.201e-05 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868435+0000", 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1920000000000005e-06 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.045 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868445+0000", 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9909999999999997e-06 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868650+0000", 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00020519700000000001 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868657+0000", 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5060000000000001e-06 2024-04-15T23:32:00.046 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875798+0000", 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007141072 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876016+0000", 2024-04-15T23:32:00.047 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000218316 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876164+0000", 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014811300000000001 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880696+0000", 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045315370000000004 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881556+0000", 2024-04-15T23:32:00.048 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086031699999999998 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881600+0000", 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4335000000000002e-05 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881637+0000", 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7110000000000002e-05 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.049 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.176475980999999, 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013308986, 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.050 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4099999999999998e-07 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868460+0000", 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2740000000000001e-06 2024-04-15T23:32:00.051 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868467+0000", 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3899999999999998e-06 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868479+0000", 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1951e-05 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868711+0000", 2024-04-15T23:32:00.052 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000232465 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868715+0000", 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1860000000000002e-06 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876682+0000", 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079668489999999998 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876769+0000", 2024-04-15T23:32:00.053 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6967999999999998e-05 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877143+0000", 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00037359300000000003 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880775+0000", 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036317979999999999 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881652+0000", 2024-04-15T23:32:00.054 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00087763100000000003 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881715+0000", 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2788999999999998e-05 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881765+0000", 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450999999999998e-05 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.055 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.176385840999998, 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016167357, 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.056 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868547+0000", 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2999999999999999e-07 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868551+0000", 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.848e-06 2024-04-15T23:32:00.057 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868567+0000", 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.5319999999999999e-05 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868575+0000", 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8790000000000003e-06 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:00.058 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017436900000000001 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868761+0000", 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.182e-05 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878325+0000", 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0095639330000000002 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.059 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878481+0000", 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015608399999999999 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878620+0000", 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000139288 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881779+0000", 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031593540000000001 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.060 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884634+0000", 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0028545049999999998 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884674+0000", 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9878e-05 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884713+0000", 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9249000000000003e-05 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.061 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.176333863, 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015469673, 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.062 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8100000000000002e-07 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868603+0000", 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6770000000000003e-06 2024-04-15T23:32:00.063 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868613+0000", 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5699999999999999e-06 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868620+0000", 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2830000000000004e-06 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869826+0000", 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0012064339999999999 2024-04-15T23:32:00.064 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869832+0000", 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0290000000000002e-06 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874065+0000", 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0042329510000000004 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874220+0000", 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015491699999999999 2024-04-15T23:32:00.065 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874405+0000", 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018499599999999999 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879828+0000", 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0054231410000000002 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883969+0000", 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041404559999999998 2024-04-15T23:32:00.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884024+0000", 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4944000000000001e-05 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884067+0000", 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3494000000000001e-05 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.067 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.175995188999998, 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015273920999999999, 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.068 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868937+0000", 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.47e-07 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868947+0000", 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6730000000000004e-06 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.069 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868959+0000", 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1956999999999999e-05 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868968+0000", 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.3009999999999995e-06 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869942+0000", 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00097338899999999996 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.070 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869946+0000", 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7550000000000002e-06 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875078+0000", 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051312529999999997 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000148949 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.071 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884210+0000", 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008983797 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.175077565999999, 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014939332, 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.072 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.073 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869855+0000", 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9599999999999998e-07 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869860+0000", 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9779999999999996e-06 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869871+0000", 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1032e-05 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.074 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869880+0000", 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9600000000000006e-06 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869979+0000", 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9392e-05 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869983+0000", 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6380000000000002e-06 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.075 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879365+0000", 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093823139999999992 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879554+0000", 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018925300000000001 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884793+0000", 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052388690000000002 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.076 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.175031906000001, 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.01118678, 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8599999999999998e-07 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869903+0000", 2024-04-15T23:32:00.078 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9979999999999999e-06 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869999+0000", 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5710000000000004e-05 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870008+0000", 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1600000000000004e-06 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870654+0000", 2024-04-15T23:32:00.079 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00064568299999999998 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870660+0000", 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0769999999999996e-06 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876226+0000", 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055662949999999997 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876342+0000", 2024-04-15T23:32:00.080 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011568700000000001 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881086+0000", 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0047445839999999996 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.174322933999999, 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.006624909, 2024-04-15T23:32:00.081 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.082 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7399999999999999e-07 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870622+0000", 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2914e-05 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870653+0000", 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0806000000000003e-05 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.083 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870670+0000", 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.694e-05 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.872456+0000", 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017861940000000001 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877234+0000", 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004777781 2024-04-15T23:32:00.084 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.171254558000001, 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0058784350000000004, 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.085 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.67e-07 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.086 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873697+0000", 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9491999999999999e-05 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873708+0000", 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0893999999999999e-05 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873726+0000", 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7999000000000002e-05 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.087 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873911+0000", 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018578600000000001 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873936+0000", 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4454999999999999e-05 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879501+0000", 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055647470000000001 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.088 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879555+0000", 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4795e-05 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.167460975000001, 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037213989999999998, 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.089 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.090 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877477+0000", 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3319999999999997e-06 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877486+0000", 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0550000000000005e-06 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.091 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877505+0000", 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8844000000000001e-05 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877620+0000", 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114393 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877639+0000", 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8788e-05 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.092 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881149+0000", 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003510862 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881192+0000", 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2571000000000003e-05 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:00.093 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.167411802, 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037611580000000001, 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:00.094 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.72e-07 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877531+0000", 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.075e-05 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877540+0000", 2024-04-15T23:32:00.095 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8680000000000005e-06 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877547+0000", 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.3839999999999999e-06 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877942+0000", 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00039470199999999998 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877960+0000", 2024-04-15T23:32:00.096 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8241999999999999e-05 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881250+0000", 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032902949999999999 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881281+0000", 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0545e-05 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.167374272, 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037922429999999998, 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:00.098 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877558+0000", 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1899999999999998e-07 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.099 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877564+0000", 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5409999999999997e-06 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877572+0000", 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5549999999999997e-06 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877579+0000", 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8190000000000003e-06 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.100 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877735+0000", 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000156133 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877754+0000", 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9559e-05 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881307+0000", 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00355296 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.101 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881349+0000", 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2256999999999999e-05 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 3 lcod 14'1)", 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.164589901999999, 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00023478400000000001, 2024-04-15T23:32:00.102 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.103 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2799999999999996e-07 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880346+0000", 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4359999999999998e-06 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880461+0000", 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011513700000000001 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.104 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880470+0000", 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7900000000000005e-06 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880527+0000", 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7095999999999997e-05 2024-04-15T23:32:00.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880576+0000", 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9796999999999998e-05 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.161006841999999, 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029033999999999999, 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.106 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.107 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9400000000000001e-07 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883929+0000", 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9890000000000003e-06 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883938+0000", 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4640000000000006e-06 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.108 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883944+0000", 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8870000000000003e-06 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884099+0000", 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015466199999999999 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884215+0000", 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115944 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.109 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:7 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.160631894000002, 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029787699999999999, 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.110 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9099999999999999e-07 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.111 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884303+0000", 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1240000000000001e-06 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884310+0000", 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1330000000000001e-06 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884317+0000", 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9920000000000001e-06 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.112 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884512+0000", 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00019436900000000001 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884518+0000", 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1770000000000003e-06 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884598+0000", 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9691000000000007e-05 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.113 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 29.160546812, 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033810099999999999, 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.114 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2600000000000002e-07 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.115 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884389+0000", 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8449999999999996e-06 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884398+0000", 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884404+0000", 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0780000000000001e-06 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.116 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884623+0000", 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00021912599999999999 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884630+0000", 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9419999999999998e-06 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884723+0000", 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2597999999999997e-05 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.117 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 27.178868948000002, 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052092120000000004, 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:00.118 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866064+0000", 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.813e-06 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.119 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866072+0000", 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866085+0000", 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3179e-05 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866091+0000", 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0809999999999999e-06 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.120 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866178+0000", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6945000000000002e-05 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866183+0000", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4710000000000001e-06 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869710+0000", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0035276610000000001 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.121 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869800+0000", 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0153000000000002e-05 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869885+0000", 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4478e-05 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.870362+0000", 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047698899999999998 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.122 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871210+0000", 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00084789999999999996 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871244+0000", 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4561999999999999e-05 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871272+0000", 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7461999999999999e-05 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.123 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 8.176843431, 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001586395, 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.124 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868089+0000", 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1710000000000001e-06 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868098+0000", 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:32:00.125 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868115+0000", 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6843000000000001e-05 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868143+0000", 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7512e-05 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868212+0000", 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9487999999999996e-05 2024-04-15T23:32:00.126 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868288+0000", 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5629000000000004e-05 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868389+0000", 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100985 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869162+0000", 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00077331800000000005 2024-04-15T23:32:00.127 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869608+0000", 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00044655299999999998 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869642+0000", 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4010000000000001e-05 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869674+0000", 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1999999999999999e-05 2024-04-15T23:32:00.128 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.129 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.129 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.129 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:00.129 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:00.129 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:00.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:00.131 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:00.147+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:00.193 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:00.194 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:32:00.204 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-15T23:31:59.773529+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596050,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":255,"num_write_kb":3481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":95232,"kb_used_data":1688,"kb_used_omap":4,"kb_used_meta":93499,"kb_avail":283020288,"statfs":{"total":289910292480,"available":289812774912,"internally_reserved":0,"allocated":1728512,"data_stored":1368257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":95743311},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.315576"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685543+0000","last_change":"2024-04-15T23:31:30.872323+0000","last_active":"2024-04-15T23:31:55.685543+0000","last_peered":"2024-04-15T23:31:55.685543+0000","last_clean":"2024-04-15T23:31:55.685543+0000","last_became_active":"2024-04-15T23:31:30.871856+0000","last_became_peered":"2024-04-15T23:31:30.871856+0000","last_unstale":"2024-04-15T23:31:55.685543+0000","last_undegraded":"2024-04-15T23:31:55.685543+0000","last_fullsized":"2024-04-15T23:31:55.685543+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685344+0000","last_change":"2024-04-15T23:31:30.878349+0000","last_active":"2024-04-15T23:31:55.685344+0000","last_peered":"2024-04-15T23:31:55.685344+0000","last_clean":"2024-04-15T23:31:55.685344+0000","last_became_active":"2024-04-15T23:31:30.877954+0000","last_became_peered":"2024-04-15T23:31:30.877954+0000","last_unstale":"2024-04-15T23:31:55.685344+0000","last_undegraded":"2024-04-15T23:31:55.685344+0000","last_fullsized":"2024-04-15T23:31:55.685344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462425+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:31:55.462425+0000","last_peered":"2024-04-15T23:31:55.462425+0000","last_clean":"2024-04-15T23:31:55.462425+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:31:55.462425+0000","last_undegraded":"2024-04-15T23:31:55.462425+0000","last_fullsized":"2024-04-15T23:31:55.462425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462237+0000","last_change":"2024-04-15T23:31:30.880368+0000","last_active":"2024-04-15T23:31:55.462237+0000","last_peered":"2024-04-15T23:31:55.462237+0000","last_clean":"2024-04-15T23:31:55.462237+0000","last_became_active":"2024-04-15T23:31:30.879628+0000","last_became_peered":"2024-04-15T23:31:30.879628+0000","last_unstale":"2024-04-15T23:31:55.462237+0000","last_undegraded":"2024-04-15T23:31:55.462237+0000","last_fullsized":"2024-04-15T23:31:55.462237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685111+0000","last_change":"2024-04-15T23:31:30.875315+0000","last_active":"2024-04-15T23:31:55.685111+0000","last_peered":"2024-04-15T23:31:55.685111+0000","last_clean":"2024-04-15T23:31:55.685111+0000","last_became_active":"2024-04-15T23:31:30.874748+0000","last_became_peered":"2024-04-15T23:31:30.874748+0000","last_unstale":"2024-04-15T23:31:55.685111+0000","last_undegraded":"2024-04-15T23:31:55.685111+0000","last_fullsized":"2024-04-15T23:31:55.685111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461942+0000","last_change":"2024-04-15T23:31:30.881605+0000","last_active":"2024-04-15T23:31:55.461942+0000","last_peered":"2024-04-15T23:31:55.461942+0000","last_clean":"2024-04-15T23:31:55.461942+0000","last_became_active":"2024-04-15T23:31:30.881248+0000","last_became_peered":"2024-04-15T23:31:30.881248+0000","last_unstale":"2024-04-15T23:31:55.461942+0000","last_undegraded":"2024-04-15T23:31:55.461942+0000","last_fullsized":"2024-04-15T23:31:55.461942+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462096+0000","last_change":"2024-04-15T23:31:30.877308+0000","last_active":"2024-04-15T23:31:55.462096+0000","last_peered":"2024-04-15T23:31:55.462096+0000","last_clean":"2024-04-15T23:31:55.462096+0000","last_became_active":"2024-04-15T23:31:30.876879+0000","last_became_peered":"2024-04-15T23:31:30.876879+0000","last_unstale":"2024-04-15T23:31:55.462096+0000","last_undegraded":"2024-04-15T23:31:55.462096+0000","last_fullsized":"2024-04-15T23:31:55.462096+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461765+0000","last_change":"2024-04-15T23:31:30.883317+0000","last_active":"2024-04-15T23:31:55.461765+0000","last_peered":"2024-04-15T23:31:55.461765+0000","last_clean":"2024-04-15T23:31:55.461765+0000","last_became_active":"2024-04-15T23:31:30.882649+0000","last_became_peered":"2024-04-15T23:31:30.882649+0000","last_unstale":"2024-04-15T23:31:55.461765+0000","last_undegraded":"2024-04-15T23:31:55.461765+0000","last_fullsized":"2024-04-15T23:31:55.461765+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476457+0000","last_change":"2024-04-15T23:31:30.880504+0000","last_active":"2024-04-15T23:31:58.476457+0000","last_peered":"2024-04-15T23:31:58.476457+0000","last_clean":"2024-04-15T23:31:58.476457+0000","last_became_active":"2024-04-15T23:31:30.880031+0000","last_became_peered":"2024-04-15T23:31:30.880031+0000","last_unstale":"2024-04-15T23:31:58.476457+0000","last_undegraded":"2024-04-15T23:31:58.476457+0000","last_fullsized":"2024-04-15T23:31:58.476457+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685371+0000","last_change":"2024-04-15T23:31:30.878317+0000","last_active":"2024-04-15T23:31:55.685371+0000","last_peered":"2024-04-15T23:31:55.685371+0000","last_clean":"2024-04-15T23:31:55.685371+0000","last_became_active":"2024-04-15T23:31:30.877947+0000","last_became_peered":"2024-04-15T23:31:30.877947+0000","last_unstale":"2024-04-15T23:31:55.685371+0000","last_undegraded":"2024-04-15T23:31:55.685371+0000","last_fullsized":"2024-04-15T23:31:55.685371+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462592+0000","last_change":"2024-04-15T23:31:30.879255+0000","last_active":"2024-04-15T23:31:55.462592+0000","last_peered":"2024-04-15T23:31:55.462592+0000","last_clean":"2024-04-15T23:31:55.462592+0000","last_became_active":"2024-04-15T23:31:30.877494+0000","last_became_peered":"2024-04-15T23:31:30.877494+0000","last_unstale":"2024-04-15T23:31:55.462592+0000","last_undegraded":"2024-04-15T23:31:55.462592+0000","last_fullsized":"2024-04-15T23:31:55.462592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685181+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:31:55.685181+0000","last_peered":"2024-04-15T23:31:55.685181+0000","last_clean":"2024-04-15T23:31:55.685181+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:31:55.685181+0000","last_undegraded":"2024-04-15T23:31:55.685181+0000","last_fullsized":"2024-04-15T23:31:55.685181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685021+0000","last_change":"2024-04-15T23:31:30.875703+0000","last_active":"2024-04-15T23:31:55.685021+0000","last_peered":"2024-04-15T23:31:55.685021+0000","last_clean":"2024-04-15T23:31:55.685021+0000","last_became_active":"2024-04-15T23:31:30.874832+0000","last_became_peered":"2024-04-15T23:31:30.874832+0000","last_unstale":"2024-04-15T23:31:55.685021+0000","last_undegraded":"2024-04-15T23:31:55.685021+0000","last_fullsized":"2024-04-15T23:31:55.685021+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461979+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:31:55.461979+0000","last_peered":"2024-04-15T23:31:55.461979+0000","last_clean":"2024-04-15T23:31:55.461979+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:31:55.461979+0000","last_undegraded":"2024-04-15T23:31:55.461979+0000","last_fullsized":"2024-04-15T23:31:55.461979+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462201+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:31:55.462201+0000","last_peered":"2024-04-15T23:31:55.462201+0000","last_clean":"2024-04-15T23:31:55.462201+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:31:55.462201+0000","last_undegraded":"2024-04-15T23:31:55.462201+0000","last_fullsized":"2024-04-15T23:31:55.462201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461806+0000","last_change":"2024-04-15T23:31:30.880915+0000","last_active":"2024-04-15T23:31:55.461806+0000","last_peered":"2024-04-15T23:31:55.461806+0000","last_clean":"2024-04-15T23:31:55.461806+0000","last_became_active":"2024-04-15T23:31:30.880429+0000","last_became_peered":"2024-04-15T23:31:30.880429+0000","last_unstale":"2024-04-15T23:31:55.461806+0000","last_undegraded":"2024-04-15T23:31:55.461806+0000","last_fullsized":"2024-04-15T23:31:55.461806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476817+0000","last_change":"2024-04-15T23:31:30.881379+0000","last_active":"2024-04-15T23:31:58.476817+0000","last_peered":"2024-04-15T23:31:58.476817+0000","last_clean":"2024-04-15T23:31:58.476817+0000","last_became_active":"2024-04-15T23:31:30.881040+0000","last_became_peered":"2024-04-15T23:31:30.881040+0000","last_unstale":"2024-04-15T23:31:58.476817+0000","last_undegraded":"2024-04-15T23:31:58.476817+0000","last_fullsized":"2024-04-15T23:31:58.476817+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685535+0000","last_change":"2024-04-15T23:31:30.872523+0000","last_active":"2024-04-15T23:31:55.685535+0000","last_peered":"2024-04-15T23:31:55.685535+0000","last_clean":"2024-04-15T23:31:55.685535+0000","last_became_active":"2024-04-15T23:31:30.872134+0000","last_became_peered":"2024-04-15T23:31:30.872134+0000","last_unstale":"2024-04-15T23:31:55.685535+0000","last_undegraded":"2024-04-15T23:31:55.685535+0000","last_fullsized":"2024-04-15T23:31:55.685535+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476357+0000","last_change":"2024-04-15T23:31:30.879572+0000","last_active":"2024-04-15T23:31:58.476357+0000","last_peered":"2024-04-15T23:31:58.476357+0000","last_clean":"2024-04-15T23:31:58.476357+0000","last_became_active":"2024-04-15T23:31:30.879103+0000","last_became_peered":"2024-04-15T23:31:30.879103+0000","last_unstale":"2024-04-15T23:31:58.476357+0000","last_undegraded":"2024-04-15T23:31:58.476357+0000","last_fullsized":"2024-04-15T23:31:58.476357+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:42:18.297831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462311+0000","last_change":"2024-04-15T23:31:30.881910+0000","last_active":"2024-04-15T23:31:55.462311+0000","last_peered":"2024-04-15T23:31:55.462311+0000","last_clean":"2024-04-15T23:31:55.462311+0000","last_became_active":"2024-04-15T23:31:30.881410+0000","last_became_peered":"2024-04-15T23:31:30.881410+0000","last_unstale":"2024-04-15T23:31:55.462311+0000","last_undegraded":"2024-04-15T23:31:55.462311+0000","last_fullsized":"2024-04-15T23:31:55.462311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:07:35.243272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462383+0000","last_change":"2024-04-15T23:31:30.879537+0000","last_active":"2024-04-15T23:31:55.462383+0000","last_peered":"2024-04-15T23:31:55.462383+0000","last_clean":"2024-04-15T23:31:55.462383+0000","last_became_active":"2024-04-15T23:31:30.878654+0000","last_became_peered":"2024-04-15T23:31:30.878654+0000","last_unstale":"2024-04-15T23:31:55.462383+0000","last_undegraded":"2024-04-15T23:31:55.462383+0000","last_fullsized":"2024-04-15T23:31:55.462383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:05:04.232740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684897+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:31:55.684897+0000","last_peered":"2024-04-15T23:31:55.684897+0000","last_clean":"2024-04-15T23:31:55.684897+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:31:55.684897+0000","last_undegraded":"2024-04-15T23:31:55.684897+0000","last_fullsized":"2024-04-15T23:31:55.684897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475702+0000","last_change":"2024-04-15T23:31:30.878432+0000","last_active":"2024-04-15T23:31:58.475702+0000","last_peered":"2024-04-15T23:31:58.475702+0000","last_clean":"2024-04-15T23:31:58.475702+0000","last_became_active":"2024-04-15T23:31:30.877798+0000","last_became_peered":"2024-04-15T23:31:30.877798+0000","last_unstale":"2024-04-15T23:31:58.475702+0000","last_undegraded":"2024-04-15T23:31:58.475702+0000","last_fullsized":"2024-04-15T23:31:58.475702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684733+0000","last_change":"2024-04-15T23:31:30.876283+0000","last_active":"2024-04-15T23:31:55.684733+0000","last_peered":"2024-04-15T23:31:55.684733+0000","last_clean":"2024-04-15T23:31:55.684733+0000","last_became_active":"2024-04-15T23:31:30.875821+0000","last_became_peered":"2024-04-15T23:31:30.875821+0000","last_unstale":"2024-04-15T23:31:55.684733+0000","last_undegraded":"2024-04-15T23:31:55.684733+0000","last_fullsized":"2024-04-15T23:31:55.684733+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:46:34.050065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685588+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:31:55.685588+0000","last_peered":"2024-04-15T23:31:55.685588+0000","last_clean":"2024-04-15T23:31:55.685588+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:31:55.685588+0000","last_undegraded":"2024-04-15T23:31:55.685588+0000","last_fullsized":"2024-04-15T23:31:55.685588+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476567+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:58.476567+0000","last_peered":"2024-04-15T23:31:58.476567+0000","last_clean":"2024-04-15T23:31:58.476567+0000","last_became_active":"2024-04-15T23:31:30.882777+0000","last_became_peered":"2024-04-15T23:31:30.882777+0000","last_unstale":"2024-04-15T23:31:58.476567+0000","last_undegraded":"2024-04-15T23:31:58.476567+0000","last_fullsized":"2024-04-15T23:31:58.476567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462632+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:31:55.462632+0000","last_peered":"2024-04-15T23:31:55.462632+0000","last_clean":"2024-04-15T23:31:55.462632+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:31:55.462632+0000","last_undegraded":"2024-04-15T23:31:55.462632+0000","last_fullsized":"2024-04-15T23:31:55.462632+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685344+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:31:55.685344+0000","last_peered":"2024-04-15T23:31:55.685344+0000","last_clean":"2024-04-15T23:31:55.685344+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:31:55.685344+0000","last_undegraded":"2024-04-15T23:31:55.685344+0000","last_fullsized":"2024-04-15T23:31:55.685344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476271+0000","last_change":"2024-04-15T23:31:30.878304+0000","last_active":"2024-04-15T23:31:58.476271+0000","last_peered":"2024-04-15T23:31:58.476271+0000","last_clean":"2024-04-15T23:31:58.476271+0000","last_became_active":"2024-04-15T23:31:30.877669+0000","last_became_peered":"2024-04-15T23:31:30.877669+0000","last_unstale":"2024-04-15T23:31:58.476271+0000","last_undegraded":"2024-04-15T23:31:58.476271+0000","last_fullsized":"2024-04-15T23:31:58.476271+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685018+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:31:55.685018+0000","last_peered":"2024-04-15T23:31:55.685018+0000","last_clean":"2024-04-15T23:31:55.685018+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:31:55.685018+0000","last_undegraded":"2024-04-15T23:31:55.685018+0000","last_fullsized":"2024-04-15T23:31:55.685018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475763+0000","last_change":"2024-04-15T23:31:30.876425+0000","last_active":"2024-04-15T23:31:58.475763+0000","last_peered":"2024-04-15T23:31:58.475763+0000","last_clean":"2024-04-15T23:31:58.475763+0000","last_became_active":"2024-04-15T23:31:30.876066+0000","last_became_peered":"2024-04-15T23:31:30.876066+0000","last_unstale":"2024-04-15T23:31:58.475763+0000","last_undegraded":"2024-04-15T23:31:58.475763+0000","last_fullsized":"2024-04-15T23:31:58.475763+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461882+0000","last_change":"2024-04-15T23:31:30.879261+0000","last_active":"2024-04-15T23:31:55.461882+0000","last_peered":"2024-04-15T23:31:55.461882+0000","last_clean":"2024-04-15T23:31:55.461882+0000","last_became_active":"2024-04-15T23:31:30.878677+0000","last_became_peered":"2024-04-15T23:31:30.878677+0000","last_unstale":"2024-04-15T23:31:55.461882+0000","last_undegraded":"2024-04-15T23:31:55.461882+0000","last_fullsized":"2024-04-15T23:31:55.461882+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685263+0000","last_change":"2024-04-15T23:31:30.876813+0000","last_active":"2024-04-15T23:31:55.685263+0000","last_peered":"2024-04-15T23:31:55.685263+0000","last_clean":"2024-04-15T23:31:55.685263+0000","last_became_active":"2024-04-15T23:31:30.876253+0000","last_became_peered":"2024-04-15T23:31:30.876253+0000","last_unstale":"2024-04-15T23:31:55.685263+0000","last_undegraded":"2024-04-15T23:31:55.685263+0000","last_fullsized":"2024-04-15T23:31:55.685263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462403+0000","last_change":"2024-04-15T23:31:29.873736+0000","last_active":"2024-04-15T23:31:55.462403+0000","last_peered":"2024-04-15T23:31:55.462403+0000","last_clean":"2024-04-15T23:31:55.462403+0000","last_became_active":"2024-04-15T23:31:29.872683+0000","last_became_peered":"2024-04-15T23:31:29.872683+0000","last_unstale":"2024-04-15T23:31:55.462403+0000","last_undegraded":"2024-04-15T23:31:55.462403+0000","last_fullsized":"2024-04-15T23:31:55.462403+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685366+0000","last_change":"2024-04-15T23:31:30.874087+0000","last_active":"2024-04-15T23:31:55.685366+0000","last_peered":"2024-04-15T23:31:55.685366+0000","last_clean":"2024-04-15T23:31:55.685366+0000","last_became_active":"2024-04-15T23:31:30.873272+0000","last_became_peered":"2024-04-15T23:31:30.873272+0000","last_unstale":"2024-04-15T23:31:55.685366+0000","last_undegraded":"2024-04-15T23:31:55.685366+0000","last_fullsized":"2024-04-15T23:31:55.685366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475983+0000","last_change":"2024-04-15T23:31:29.876572+0000","last_active":"2024-04-15T23:31:58.475983+0000","last_peered":"2024-04-15T23:31:58.475983+0000","last_clean":"2024-04-15T23:31:58.475983+0000","last_became_active":"2024-04-15T23:31:29.876316+0000","last_became_peered":"2024-04-15T23:31:29.876316+0000","last_unstale":"2024-04-15T23:31:58.475983+0000","last_undegraded":"2024-04-15T23:31:58.475983+0000","last_fullsized":"2024-04-15T23:31:58.475983+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476716+0000","last_change":"2024-04-15T23:31:30.883148+0000","last_active":"2024-04-15T23:31:58.476716+0000","last_peered":"2024-04-15T23:31:58.476716+0000","last_clean":"2024-04-15T23:31:58.476716+0000","last_became_active":"2024-04-15T23:31:30.882831+0000","last_became_peered":"2024-04-15T23:31:30.882831+0000","last_unstale":"2024-04-15T23:31:58.476716+0000","last_undegraded":"2024-04-15T23:31:58.476716+0000","last_fullsized":"2024-04-15T23:31:58.476716+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:02:17.604178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684931+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:31:55.684931+0000","last_peered":"2024-04-15T23:31:55.684931+0000","last_clean":"2024-04-15T23:31:55.684931+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:31:55.684931+0000","last_undegraded":"2024-04-15T23:31:55.684931+0000","last_fullsized":"2024-04-15T23:31:55.684931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476454+0000","last_change":"2024-04-15T23:31:30.883129+0000","last_active":"2024-04-15T23:31:58.476454+0000","last_peered":"2024-04-15T23:31:58.476454+0000","last_clean":"2024-04-15T23:31:58.476454+0000","last_became_active":"2024-04-15T23:31:30.882804+0000","last_became_peered":"2024-04-15T23:31:30.882804+0000","last_unstale":"2024-04-15T23:31:58.476454+0000","last_undegraded":"2024-04-15T23:31:58.476454+0000","last_fullsized":"2024-04-15T23:31:58.476454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":28,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461981+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:31:55.461981+0000","last_peered":"2024-04-15T23:31:55.461981+0000","last_clean":"2024-04-15T23:31:55.461981+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:31:55.461981+0000","last_undegraded":"2024-04-15T23:31:55.461981+0000","last_fullsized":"2024-04-15T23:31:55.461981+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462633+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:31:55.462633+0000","last_peered":"2024-04-15T23:31:55.462633+0000","last_clean":"2024-04-15T23:31:55.462633+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:31:55.462633+0000","last_undegraded":"2024-04-15T23:31:55.462633+0000","last_fullsized":"2024-04-15T23:31:55.462633+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684746+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:31:55.684746+0000","last_peered":"2024-04-15T23:31:55.684746+0000","last_clean":"2024-04-15T23:31:55.684746+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:31:55.684746+0000","last_undegraded":"2024-04-15T23:31:55.684746+0000","last_fullsized":"2024-04-15T23:31:55.684746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685543+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:31:55.685543+0000","last_peered":"2024-04-15T23:31:55.685543+0000","last_clean":"2024-04-15T23:31:55.685543+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:31:55.685543+0000","last_undegraded":"2024-04-15T23:31:55.685543+0000","last_fullsized":"2024-04-15T23:31:55.685543+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684801+0000","last_change":"2024-04-15T23:31:30.873344+0000","last_active":"2024-04-15T23:31:55.684801+0000","last_peered":"2024-04-15T23:31:55.684801+0000","last_clean":"2024-04-15T23:31:55.684801+0000","last_became_active":"2024-04-15T23:31:30.873022+0000","last_became_peered":"2024-04-15T23:31:30.873022+0000","last_unstale":"2024-04-15T23:31:55.684801+0000","last_undegraded":"2024-04-15T23:31:55.684801+0000","last_fullsized":"2024-04-15T23:31:55.684801+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:17:35.817259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462813+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:31:55.462813+0000","last_peered":"2024-04-15T23:31:55.462813+0000","last_clean":"2024-04-15T23:31:55.462813+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:31:55.462813+0000","last_undegraded":"2024-04-15T23:31:55.462813+0000","last_fullsized":"2024-04-15T23:31:55.462813+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462080+0000","last_change":"2024-04-15T23:31:30.878133+0000","last_active":"2024-04-15T23:31:55.462080+0000","last_peered":"2024-04-15T23:31:55.462080+0000","last_clean":"2024-04-15T23:31:55.462080+0000","last_became_active":"2024-04-15T23:31:30.876904+0000","last_became_peered":"2024-04-15T23:31:30.876904+0000","last_unstale":"2024-04-15T23:31:55.462080+0000","last_undegraded":"2024-04-15T23:31:55.462080+0000","last_fullsized":"2024-04-15T23:31:55.462080+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462519+0000","last_change":"2024-04-15T23:31:29.871289+0000","last_active":"2024-04-15T23:31:55.462519+0000","last_peered":"2024-04-15T23:31:55.462519+0000","last_clean":"2024-04-15T23:31:55.462519+0000","last_became_active":"2024-04-15T23:31:29.870607+0000","last_became_peered":"2024-04-15T23:31:29.870607+0000","last_unstale":"2024-04-15T23:31:55.462519+0000","last_undegraded":"2024-04-15T23:31:55.462519+0000","last_fullsized":"2024-04-15T23:31:55.462519+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:15.732129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476075+0000","last_change":"2024-04-15T23:31:30.884289+0000","last_active":"2024-04-15T23:31:58.476075+0000","last_peered":"2024-04-15T23:31:58.476075+0000","last_clean":"2024-04-15T23:31:58.476075+0000","last_became_active":"2024-04-15T23:31:30.884085+0000","last_became_peered":"2024-04-15T23:31:30.884085+0000","last_unstale":"2024-04-15T23:31:58.476075+0000","last_undegraded":"2024-04-15T23:31:58.476075+0000","last_fullsized":"2024-04-15T23:31:58.476075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476453+0000","last_change":"2024-04-15T23:31:29.877430+0000","last_active":"2024-04-15T23:31:58.476453+0000","last_peered":"2024-04-15T23:31:58.476453+0000","last_clean":"2024-04-15T23:31:58.476453+0000","last_became_active":"2024-04-15T23:31:29.877052+0000","last_became_peered":"2024-04-15T23:31:29.877052+0000","last_unstale":"2024-04-15T23:31:58.476453+0000","last_undegraded":"2024-04-15T23:31:58.476453+0000","last_fullsized":"2024-04-15T23:31:58.476453+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462328+0000","last_change":"2024-04-15T23:31:30.878422+0000","last_active":"2024-04-15T23:31:55.462328+0000","last_peered":"2024-04-15T23:31:55.462328+0000","last_clean":"2024-04-15T23:31:55.462328+0000","last_became_active":"2024-04-15T23:31:30.877172+0000","last_became_peered":"2024-04-15T23:31:30.877172+0000","last_unstale":"2024-04-15T23:31:55.462328+0000","last_undegraded":"2024-04-15T23:31:55.462328+0000","last_fullsized":"2024-04-15T23:31:55.462328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:36.755310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462269+0000","last_change":"2024-04-15T23:31:29.873808+0000","last_active":"2024-04-15T23:31:55.462269+0000","last_peered":"2024-04-15T23:31:55.462269+0000","last_clean":"2024-04-15T23:31:55.462269+0000","last_became_active":"2024-04-15T23:31:29.873483+0000","last_became_peered":"2024-04-15T23:31:29.873483+0000","last_unstale":"2024-04-15T23:31:55.462269+0000","last_undegraded":"2024-04-15T23:31:55.462269+0000","last_fullsized":"2024-04-15T23:31:55.462269+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:29:58.295611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462743+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:31:55.462743+0000","last_peered":"2024-04-15T23:31:55.462743+0000","last_clean":"2024-04-15T23:31:55.462743+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:31:55.462743+0000","last_undegraded":"2024-04-15T23:31:55.462743+0000","last_fullsized":"2024-04-15T23:31:55.462743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684911+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:31:55.684911+0000","last_peered":"2024-04-15T23:31:55.684911+0000","last_clean":"2024-04-15T23:31:55.684911+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:31:55.684911+0000","last_undegraded":"2024-04-15T23:31:55.684911+0000","last_fullsized":"2024-04-15T23:31:55.684911+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462503+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:31:55.462503+0000","last_peered":"2024-04-15T23:31:55.462503+0000","last_clean":"2024-04-15T23:31:55.462503+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:31:55.462503+0000","last_undegraded":"2024-04-15T23:31:55.462503+0000","last_fullsized":"2024-04-15T23:31:55.462503+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684830+0000","last_change":"2024-04-15T23:31:29.875645+0000","last_active":"2024-04-15T23:31:55.684830+0000","last_peered":"2024-04-15T23:31:55.684830+0000","last_clean":"2024-04-15T23:31:55.684830+0000","last_became_active":"2024-04-15T23:31:29.875173+0000","last_became_peered":"2024-04-15T23:31:29.875173+0000","last_unstale":"2024-04-15T23:31:55.684830+0000","last_undegraded":"2024-04-15T23:31:55.684830+0000","last_fullsized":"2024-04-15T23:31:55.684830+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:25.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476594+0000","last_change":"2024-04-15T23:31:30.880608+0000","last_active":"2024-04-15T23:31:58.476594+0000","last_peered":"2024-04-15T23:31:58.476594+0000","last_clean":"2024-04-15T23:31:58.476594+0000","last_became_active":"2024-04-15T23:31:30.880051+0000","last_became_peered":"2024-04-15T23:31:30.880051+0000","last_unstale":"2024-04-15T23:31:58.476594+0000","last_undegraded":"2024-04-15T23:31:58.476594+0000","last_fullsized":"2024-04-15T23:31:58.476594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462211+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:31:55.462211+0000","last_peered":"2024-04-15T23:31:55.462211+0000","last_clean":"2024-04-15T23:31:55.462211+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:31:55.462211+0000","last_undegraded":"2024-04-15T23:31:55.462211+0000","last_fullsized":"2024-04-15T23:31:55.462211+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462692+0000","last_change":"2024-04-15T23:31:25.587282+0000","last_active":"2024-04-15T23:31:55.462692+0000","last_peered":"2024-04-15T23:31:55.462692+0000","last_clean":"2024-04-15T23:31:55.462692+0000","last_became_active":"2024-04-15T23:31:25.586954+0000","last_became_peered":"2024-04-15T23:31:25.586954+0000","last_unstale":"2024-04-15T23:31:55.462692+0000","last_undegraded":"2024-04-15T23:31:55.462692+0000","last_fullsized":"2024-04-15T23:31:55.462692+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:00.831236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476124+0000","last_change":"2024-04-15T23:31:29.875281+0000","last_active":"2024-04-15T23:31:58.476124+0000","last_peered":"2024-04-15T23:31:58.476124+0000","last_clean":"2024-04-15T23:31:58.476124+0000","last_became_active":"2024-04-15T23:31:29.874975+0000","last_became_peered":"2024-04-15T23:31:29.874975+0000","last_unstale":"2024-04-15T23:31:58.476124+0000","last_undegraded":"2024-04-15T23:31:58.476124+0000","last_fullsized":"2024-04-15T23:31:58.476124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462764+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:31:55.462764+0000","last_peered":"2024-04-15T23:31:55.462764+0000","last_clean":"2024-04-15T23:31:55.462764+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:31:55.462764+0000","last_undegraded":"2024-04-15T23:31:55.462764+0000","last_fullsized":"2024-04-15T23:31:55.462764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462101+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:31:55.462101+0000","last_peered":"2024-04-15T23:31:55.462101+0000","last_clean":"2024-04-15T23:31:55.462101+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:31:55.462101+0000","last_undegraded":"2024-04-15T23:31:55.462101+0000","last_fullsized":"2024-04-15T23:31:55.462101+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475965+0000","last_change":"2024-04-15T23:31:29.877347+0000","last_active":"2024-04-15T23:31:58.475965+0000","last_peered":"2024-04-15T23:31:58.475965+0000","last_clean":"2024-04-15T23:31:58.475965+0000","last_became_active":"2024-04-15T23:31:29.876799+0000","last_became_peered":"2024-04-15T23:31:29.876799+0000","last_unstale":"2024-04-15T23:31:58.475965+0000","last_undegraded":"2024-04-15T23:31:58.475965+0000","last_fullsized":"2024-04-15T23:31:58.475965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685440+0000","last_change":"2024-04-15T23:31:30.874384+0000","last_active":"2024-04-15T23:31:55.685440+0000","last_peered":"2024-04-15T23:31:55.685440+0000","last_clean":"2024-04-15T23:31:55.685440+0000","last_became_active":"2024-04-15T23:31:30.874002+0000","last_became_peered":"2024-04-15T23:31:30.874002+0000","last_unstale":"2024-04-15T23:31:55.685440+0000","last_undegraded":"2024-04-15T23:31:55.685440+0000","last_fullsized":"2024-04-15T23:31:55.685440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476135+0000","last_change":"2024-04-15T23:31:25.588758+0000","last_active":"2024-04-15T23:31:58.476135+0000","last_peered":"2024-04-15T23:31:58.476135+0000","last_clean":"2024-04-15T23:31:58.476135+0000","last_became_active":"2024-04-15T23:31:25.588506+0000","last_became_peered":"2024-04-15T23:31:25.588506+0000","last_unstale":"2024-04-15T23:31:58.476135+0000","last_undegraded":"2024-04-15T23:31:58.476135+0000","last_fullsized":"2024-04-15T23:31:58.476135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684834+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:31:55.684834+0000","last_peered":"2024-04-15T23:31:55.684834+0000","last_clean":"2024-04-15T23:31:55.684834+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:31:55.684834+0000","last_undegraded":"2024-04-15T23:31:55.684834+0000","last_fullsized":"2024-04-15T23:31:55.684834+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476606+0000","last_change":"2024-04-15T23:31:30.881193+0000","last_active":"2024-04-15T23:31:58.476606+0000","last_peered":"2024-04-15T23:31:58.476606+0000","last_clean":"2024-04-15T23:31:58.476606+0000","last_became_active":"2024-04-15T23:31:30.880901+0000","last_became_peered":"2024-04-15T23:31:30.880901+0000","last_unstale":"2024-04-15T23:31:58.476606+0000","last_undegraded":"2024-04-15T23:31:58.476606+0000","last_fullsized":"2024-04-15T23:31:58.476606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462344+0000","last_change":"2024-04-15T23:31:25.587338+0000","last_active":"2024-04-15T23:31:55.462344+0000","last_peered":"2024-04-15T23:31:55.462344+0000","last_clean":"2024-04-15T23:31:55.462344+0000","last_became_active":"2024-04-15T23:31:25.586988+0000","last_became_peered":"2024-04-15T23:31:25.586988+0000","last_unstale":"2024-04-15T23:31:55.462344+0000","last_undegraded":"2024-04-15T23:31:55.462344+0000","last_fullsized":"2024-04-15T23:31:55.462344+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:19.629423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462623+0000","last_change":"2024-04-15T23:31:29.871992+0000","last_active":"2024-04-15T23:31:55.462623+0000","last_peered":"2024-04-15T23:31:55.462623+0000","last_clean":"2024-04-15T23:31:55.462623+0000","last_became_active":"2024-04-15T23:31:29.871368+0000","last_became_peered":"2024-04-15T23:31:29.871368+0000","last_unstale":"2024-04-15T23:31:55.462623+0000","last_undegraded":"2024-04-15T23:31:55.462623+0000","last_fullsized":"2024-04-15T23:31:55.462623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:21:49.552637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476482+0000","last_change":"2024-04-15T23:31:30.880066+0000","last_active":"2024-04-15T23:31:58.476482+0000","last_peered":"2024-04-15T23:31:58.476482+0000","last_clean":"2024-04-15T23:31:58.476482+0000","last_became_active":"2024-04-15T23:31:30.879661+0000","last_became_peered":"2024-04-15T23:31:30.879661+0000","last_unstale":"2024-04-15T23:31:58.476482+0000","last_undegraded":"2024-04-15T23:31:58.476482+0000","last_fullsized":"2024-04-15T23:31:58.476482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462825+0000","last_change":"2024-04-15T23:31:29.872840+0000","last_active":"2024-04-15T23:31:55.462825+0000","last_peered":"2024-04-15T23:31:55.462825+0000","last_clean":"2024-04-15T23:31:55.462825+0000","last_became_active":"2024-04-15T23:31:29.871825+0000","last_became_peered":"2024-04-15T23:31:29.871825+0000","last_unstale":"2024-04-15T23:31:55.462825+0000","last_undegraded":"2024-04-15T23:31:55.462825+0000","last_fullsized":"2024-04-15T23:31:55.462825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476601+0000","last_change":"2024-04-15T23:31:25.588826+0000","last_active":"2024-04-15T23:31:58.476601+0000","last_peered":"2024-04-15T23:31:58.476601+0000","last_clean":"2024-04-15T23:31:58.476601+0000","last_became_active":"2024-04-15T23:31:25.588544+0000","last_became_peered":"2024-04-15T23:31:25.588544+0000","last_unstale":"2024-04-15T23:31:58.476601+0000","last_undegraded":"2024-04-15T23:31:58.476601+0000","last_fullsized":"2024-04-15T23:31:58.476601+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:33:50.075760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684959+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:31:55.684959+0000","last_peered":"2024-04-15T23:31:55.684959+0000","last_clean":"2024-04-15T23:31:55.684959+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:31:55.684959+0000","last_undegraded":"2024-04-15T23:31:55.684959+0000","last_fullsized":"2024-04-15T23:31:55.684959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476512+0000","last_change":"2024-04-15T23:31:29.875377+0000","last_active":"2024-04-15T23:31:58.476512+0000","last_peered":"2024-04-15T23:31:58.476512+0000","last_clean":"2024-04-15T23:31:58.476512+0000","last_became_active":"2024-04-15T23:31:29.875050+0000","last_became_peered":"2024-04-15T23:31:29.875050+0000","last_unstale":"2024-04-15T23:31:58.476512+0000","last_undegraded":"2024-04-15T23:31:58.476512+0000","last_fullsized":"2024-04-15T23:31:58.476512+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:28:50.245174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685586+0000","last_change":"2024-04-15T23:31:25.587660+0000","last_active":"2024-04-15T23:31:55.685586+0000","last_peered":"2024-04-15T23:31:55.685586+0000","last_clean":"2024-04-15T23:31:55.685586+0000","last_became_active":"2024-04-15T23:31:25.587304+0000","last_became_peered":"2024-04-15T23:31:25.587304+0000","last_unstale":"2024-04-15T23:31:55.685586+0000","last_undegraded":"2024-04-15T23:31:55.685586+0000","last_fullsized":"2024-04-15T23:31:55.685586+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:21:35.579327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685050+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:31:55.685050+0000","last_peered":"2024-04-15T23:31:55.685050+0000","last_clean":"2024-04-15T23:31:55.685050+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:31:55.685050+0000","last_undegraded":"2024-04-15T23:31:55.685050+0000","last_fullsized":"2024-04-15T23:31:55.685050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":24,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476829+0000","last_change":"2024-04-15T23:31:29.878012+0000","last_active":"2024-04-15T23:31:58.476829+0000","last_peered":"2024-04-15T23:31:58.476829+0000","last_clean":"2024-04-15T23:31:58.476829+0000","last_became_active":"2024-04-15T23:31:29.877789+0000","last_became_peered":"2024-04-15T23:31:29.877789+0000","last_unstale":"2024-04-15T23:31:58.476829+0000","last_undegraded":"2024-04-15T23:31:58.476829+0000","last_fullsized":"2024-04-15T23:31:58.476829+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476790+0000","last_change":"2024-04-15T23:31:25.588735+0000","last_active":"2024-04-15T23:31:58.476790+0000","last_peered":"2024-04-15T23:31:58.476790+0000","last_clean":"2024-04-15T23:31:58.476790+0000","last_became_active":"2024-04-15T23:31:25.588454+0000","last_became_peered":"2024-04-15T23:31:25.588454+0000","last_unstale":"2024-04-15T23:31:58.476790+0000","last_undegraded":"2024-04-15T23:31:58.476790+0000","last_fullsized":"2024-04-15T23:31:58.476790+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475854+0000","last_change":"2024-04-15T23:31:30.884177+0000","last_active":"2024-04-15T23:31:58.475854+0000","last_peered":"2024-04-15T23:31:58.475854+0000","last_clean":"2024-04-15T23:31:58.475854+0000","last_became_active":"2024-04-15T23:31:30.883910+0000","last_became_peered":"2024-04-15T23:31:30.883910+0000","last_unstale":"2024-04-15T23:31:58.475854+0000","last_undegraded":"2024-04-15T23:31:58.475854+0000","last_fullsized":"2024-04-15T23:31:58.475854+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'3","reported_seq":25,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476763+0000","last_change":"2024-04-15T23:31:29.877467+0000","last_active":"2024-04-15T23:31:58.476763+0000","last_peered":"2024-04-15T23:31:58.476763+0000","last_clean":"2024-04-15T23:31:58.476763+0000","last_became_active":"2024-04-15T23:31:29.877065+0000","last_became_peered":"2024-04-15T23:31:29.877065+0000","last_unstale":"2024-04-15T23:31:58.476763+0000","last_undegraded":"2024-04-15T23:31:58.476763+0000","last_fullsized":"2024-04-15T23:31:58.476763+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462636+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:31:55.462636+0000","last_peered":"2024-04-15T23:31:55.462636+0000","last_clean":"2024-04-15T23:31:55.462636+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:31:55.462636+0000","last_undegraded":"2024-04-15T23:31:55.462636+0000","last_fullsized":"2024-04-15T23:31:55.462636+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.684804+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:31:55.684804+0000","last_peered":"2024-04-15T23:31:55.684804+0000","last_clean":"2024-04-15T23:31:55.684804+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:31:55.684804+0000","last_undegraded":"2024-04-15T23:31:55.684804+0000","last_fullsized":"2024-04-15T23:31:55.684804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462097+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:31:55.462097+0000","last_peered":"2024-04-15T23:31:55.462097+0000","last_clean":"2024-04-15T23:31:55.462097+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:31:55.462097+0000","last_undegraded":"2024-04-15T23:31:55.462097+0000","last_fullsized":"2024-04-15T23:31:55.462097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'9","reported_seq":29,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462432+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:31:55.462432+0000","last_peered":"2024-04-15T23:31:55.462432+0000","last_clean":"2024-04-15T23:31:55.462432+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:31:55.462432+0000","last_undegraded":"2024-04-15T23:31:55.462432+0000","last_fullsized":"2024-04-15T23:31:55.462432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475995+0000","last_change":"2024-04-15T23:31:30.877148+0000","last_active":"2024-04-15T23:31:58.475995+0000","last_peered":"2024-04-15T23:31:58.475995+0000","last_clean":"2024-04-15T23:31:58.475995+0000","last_became_active":"2024-04-15T23:31:30.876477+0000","last_became_peered":"2024-04-15T23:31:30.876477+0000","last_unstale":"2024-04-15T23:31:58.475995+0000","last_undegraded":"2024-04-15T23:31:58.475995+0000","last_fullsized":"2024-04-15T23:31:58.475995+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":23,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685526+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:31:55.685526+0000","last_peered":"2024-04-15T23:31:55.685526+0000","last_clean":"2024-04-15T23:31:55.685526+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:31:55.685526+0000","last_undegraded":"2024-04-15T23:31:55.685526+0000","last_fullsized":"2024-04-15T23:31:55.685526+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462623+0000","last_change":"2024-04-15T23:31:29.872714+0000","last_active":"2024-04-15T23:31:55.462623+0000","last_peered":"2024-04-15T23:31:55.462623+0000","last_clean":"2024-04-15T23:31:55.462623+0000","last_became_active":"2024-04-15T23:31:29.871957+0000","last_became_peered":"2024-04-15T23:31:29.871957+0000","last_unstale":"2024-04-15T23:31:55.462623+0000","last_undegraded":"2024-04-15T23:31:55.462623+0000","last_fullsized":"2024-04-15T23:31:55.462623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475806+0000","last_change":"2024-04-15T23:31:30.879388+0000","last_active":"2024-04-15T23:31:58.475806+0000","last_peered":"2024-04-15T23:31:58.475806+0000","last_clean":"2024-04-15T23:31:58.475806+0000","last_became_active":"2024-04-15T23:31:30.878893+0000","last_became_peered":"2024-04-15T23:31:30.878893+0000","last_unstale":"2024-04-15T23:31:58.475806+0000","last_undegraded":"2024-04-15T23:31:58.475806+0000","last_fullsized":"2024-04-15T23:31:58.475806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476740+0000","last_change":"2024-04-15T23:31:29.877445+0000","last_active":"2024-04-15T23:31:58.476740+0000","last_peered":"2024-04-15T23:31:58.476740+0000","last_clean":"2024-04-15T23:31:58.476740+0000","last_became_active":"2024-04-15T23:31:29.877083+0000","last_became_peered":"2024-04-15T23:31:29.877083+0000","last_unstale":"2024-04-15T23:31:58.476740+0000","last_undegraded":"2024-04-15T23:31:58.476740+0000","last_fullsized":"2024-04-15T23:31:58.476740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475837+0000","last_change":"2024-04-15T23:31:30.877576+0000","last_active":"2024-04-15T23:31:58.475837+0000","last_peered":"2024-04-15T23:31:58.475837+0000","last_clean":"2024-04-15T23:31:58.475837+0000","last_became_active":"2024-04-15T23:31:30.876721+0000","last_became_peered":"2024-04-15T23:31:30.876721+0000","last_unstale":"2024-04-15T23:31:58.475837+0000","last_undegraded":"2024-04-15T23:31:58.475837+0000","last_fullsized":"2024-04-15T23:31:58.475837+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:07:03.799241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685635+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:31:55.685635+0000","last_peered":"2024-04-15T23:31:55.685635+0000","last_clean":"2024-04-15T23:31:55.685635+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:31:55.685635+0000","last_undegraded":"2024-04-15T23:31:55.685635+0000","last_fullsized":"2024-04-15T23:31:55.685635+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475985+0000","last_change":"2024-04-15T23:31:29.876488+0000","last_active":"2024-04-15T23:31:58.475985+0000","last_peered":"2024-04-15T23:31:58.475985+0000","last_clean":"2024-04-15T23:31:58.475985+0000","last_became_active":"2024-04-15T23:31:29.876150+0000","last_became_peered":"2024-04-15T23:31:29.876150+0000","last_unstale":"2024-04-15T23:31:58.475985+0000","last_undegraded":"2024-04-15T23:31:58.475985+0000","last_fullsized":"2024-04-15T23:31:58.475985+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476436+0000","last_change":"2024-04-15T23:31:30.880158+0000","last_active":"2024-04-15T23:31:58.476436+0000","last_peered":"2024-04-15T23:31:58.476436+0000","last_clean":"2024-04-15T23:31:58.476436+0000","last_became_active":"2024-04-15T23:31:30.879788+0000","last_became_peered":"2024-04-15T23:31:30.879788+0000","last_unstale":"2024-04-15T23:31:58.476436+0000","last_undegraded":"2024-04-15T23:31:58.476436+0000","last_fullsized":"2024-04-15T23:31:58.476436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.475957+0000","last_change":"2024-04-15T23:31:29.876567+0000","last_active":"2024-04-15T23:31:58.475957+0000","last_peered":"2024-04-15T23:31:58.475957+0000","last_clean":"2024-04-15T23:31:58.475957+0000","last_became_active":"2024-04-15T23:31:29.876267+0000","last_became_peered":"2024-04-15T23:31:29.876267+0000","last_unstale":"2024-04-15T23:31:58.475957+0000","last_undegraded":"2024-04-15T23:31:58.475957+0000","last_fullsized":"2024-04-15T23:31:58.475957+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685269+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:31:55.685269+0000","last_peered":"2024-04-15T23:31:55.685269+0000","last_clean":"2024-04-15T23:31:55.685269+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:31:55.685269+0000","last_undegraded":"2024-04-15T23:31:55.685269+0000","last_fullsized":"2024-04-15T23:31:55.685269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685058+0000","last_change":"2024-04-15T23:31:29.875791+0000","last_active":"2024-04-15T23:31:55.685058+0000","last_peered":"2024-04-15T23:31:55.685058+0000","last_clean":"2024-04-15T23:31:55.685058+0000","last_became_active":"2024-04-15T23:31:29.875200+0000","last_became_peered":"2024-04-15T23:31:29.875200+0000","last_unstale":"2024-04-15T23:31:55.685058+0000","last_undegraded":"2024-04-15T23:31:55.685058+0000","last_fullsized":"2024-04-15T23:31:55.685058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:00:22.280644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685196+0000","last_change":"2024-04-15T23:31:30.876678+0000","last_active":"2024-04-15T23:31:55.685196+0000","last_peered":"2024-04-15T23:31:55.685196+0000","last_clean":"2024-04-15T23:31:55.685196+0000","last_became_active":"2024-04-15T23:31:30.876124+0000","last_became_peered":"2024-04-15T23:31:30.876124+0000","last_unstale":"2024-04-15T23:31:55.685196+0000","last_undegraded":"2024-04-15T23:31:55.685196+0000","last_fullsized":"2024-04-15T23:31:55.685196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:02:03.592338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685149+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:31:55.685149+0000","last_peered":"2024-04-15T23:31:55.685149+0000","last_clean":"2024-04-15T23:31:55.685149+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:31:55.685149+0000","last_undegraded":"2024-04-15T23:31:55.685149+0000","last_fullsized":"2024-04-15T23:31:55.685149+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462061+0000","last_change":"2024-04-15T23:31:30.879839+0000","last_active":"2024-04-15T23:31:55.462061+0000","last_peered":"2024-04-15T23:31:55.462061+0000","last_clean":"2024-04-15T23:31:55.462061+0000","last_became_active":"2024-04-15T23:31:30.879106+0000","last_became_peered":"2024-04-15T23:31:30.879106+0000","last_unstale":"2024-04-15T23:31:55.462061+0000","last_undegraded":"2024-04-15T23:31:55.462061+0000","last_fullsized":"2024-04-15T23:31:55.462061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:07:04.232594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462408+0000","last_change":"2024-04-15T23:31:29.872654+0000","last_active":"2024-04-15T23:31:55.462408+0000","last_peered":"2024-04-15T23:31:55.462408+0000","last_clean":"2024-04-15T23:31:55.462408+0000","last_became_active":"2024-04-15T23:31:29.871852+0000","last_became_peered":"2024-04-15T23:31:29.871852+0000","last_unstale":"2024-04-15T23:31:55.462408+0000","last_undegraded":"2024-04-15T23:31:55.462408+0000","last_fullsized":"2024-04-15T23:31:55.462408+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.462217+0000","last_change":"2024-04-15T23:31:30.878027+0000","last_active":"2024-04-15T23:31:55.462217+0000","last_peered":"2024-04-15T23:31:55.462217+0000","last_clean":"2024-04-15T23:31:55.462217+0000","last_became_active":"2024-04-15T23:31:30.876945+0000","last_became_peered":"2024-04-15T23:31:30.876945+0000","last_unstale":"2024-04-15T23:31:55.462217+0000","last_undegraded":"2024-04-15T23:31:55.462217+0000","last_fullsized":"2024-04-15T23:31:55.462217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685427+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:31:55.685427+0000","last_peered":"2024-04-15T23:31:55.685427+0000","last_clean":"2024-04-15T23:31:55.685427+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:31:55.685427+0000","last_undegraded":"2024-04-15T23:31:55.685427+0000","last_fullsized":"2024-04-15T23:31:55.685427+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.685026+0000","last_change":"2024-04-15T23:31:30.873310+0000","last_active":"2024-04-15T23:31:55.685026+0000","last_peered":"2024-04-15T23:31:55.685026+0000","last_clean":"2024-04-15T23:31:55.685026+0000","last_became_active":"2024-04-15T23:31:30.872992+0000","last_became_peered":"2024-04-15T23:31:30.872992+0000","last_unstale":"2024-04-15T23:31:55.685026+0000","last_undegraded":"2024-04-15T23:31:55.685026+0000","last_fullsized":"2024-04-15T23:31:55.685026+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:59.381933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":23,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476694+0000","last_change":"2024-04-15T23:31:29.876063+0000","last_active":"2024-04-15T23:31:58.476694+0000","last_peered":"2024-04-15T23:31:58.476694+0000","last_clean":"2024-04-15T23:31:58.476694+0000","last_became_active":"2024-04-15T23:31:29.875755+0000","last_became_peered":"2024-04-15T23:31:29.875755+0000","last_unstale":"2024-04-15T23:31:58.476694+0000","last_undegraded":"2024-04-15T23:31:58.476694+0000","last_fullsized":"2024-04-15T23:31:58.476694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:04:48.183257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-15T23:31:55.461982+0000","last_change":"2024-04-15T23:31:30.879153+0000","last_active":"2024-04-15T23:31:55.461982+0000","last_peered":"2024-04-15T23:31:55.461982+0000","last_clean":"2024-04-15T23:31:55.461982+0000","last_became_active":"2024-04-15T23:31:30.877559+0000","last_became_peered":"2024-04-15T23:31:30.877559+0000","last_unstale":"2024-04-15T23:31:55.461982+0000","last_undegraded":"2024-04-15T23:31:55.461982+0000","last_fullsized":"2024-04-15T23:31:55.461982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:01:21.586035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":26,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-15T23:31:58.476677+0000","last_change":"2024-04-15T23:31:29.877267+0000","last_active":"2024-04-15T23:31:58.476677+0000","last_peered":"2024-04-15T23:31:58.476677+0000","last_clean":"2024-04-15T23:31:58.476677+0000","last_became_active":"2024-04-15T23:31:29.876878+0000","last_became_peered":"2024-04-15T23:31:29.876878+0000","last_unstale":"2024-04-15T23:31:58.476677+0000","last_undegraded":"2024-04-15T23:31:58.476677+0000","last_fullsized":"2024-04-15T23:31:58.476677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:21:54.724174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5682,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738379,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":163840,"data_stored":59335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738379,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":654769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":654153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:32:00.209 INFO:tasks.thrashosds.thrasher:Setting 4.9 to [0, 1] 2024-04-15T23:32:00.209 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.9', '0', '1'] 2024-04-15T23:32:00.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.9 0 1 2024-04-15T23:32:00.231 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:00.248+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:00.249 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:00.250 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:00.259 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:00.332 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:00.348+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:00.367 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:00.368 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:00.368 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:00.368 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:00.368 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:00.376 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:00.432 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:00.449+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:00.475 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.430123975000001, 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.429431430999998, 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.429039517, 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.428705072, 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.427409719000003, 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:00.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:00.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.075143855999997, 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:00.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.074920853999998, 2024-04-15T23:32:00.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:00.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:00.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.074480010999999, 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.073828054000003, 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.073021787000002, 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.532 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.536 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.070921292999998, 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:00.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:00.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:00.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.633457215, 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:00.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:00.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:00.548 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.633400471000002, 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:00.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:00.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.633289314999999, 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:00.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:00.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.633202301000001, 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:00.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:00.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:00.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.633168600000001, 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:00.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:00.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:00.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.632980061000001, 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:00.573 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:00.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:00.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.632935842999998, 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:00.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:00.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.632895344000001, 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:00.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.632853634, 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:00.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:00.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:00.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:00.595 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:00.597 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:00.613+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:00.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:00.698 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:00.715+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:00.717 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:00.717 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:00.717 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:00.717 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:00.727 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:00.798 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:00.815+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:00.836 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:00.836 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:00.836 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:00.836 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:00.836 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:00.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:00.899 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:00.916+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:00.995 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.941142194000001, 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:00.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:00.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:00.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:01.001 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.941060706000002, 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:01.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:01.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:01.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142969014999998, 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:01.007 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.012 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142921025, 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.017 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142882726, 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:01.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142843937999999, 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.023 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:01.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:01.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:01.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142820607000001, 2024-04-15T23:32:01.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:01.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:01.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142790122000001, 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:01.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:01.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142755052999998, 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:01.039 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:01.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:01.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142731309999999, 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:01.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:01.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142707050999999, 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.050 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:01.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:01.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.055 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142678711999999, 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:01.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142639913, 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.061 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.066 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142604742, 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:01.072 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142571373999999, 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:01.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:01.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:01.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.142513912999998, 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.078 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:01.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:01.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.140878253, 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:01.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:01.089 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.139986721, 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:01.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.139935373, 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.095 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:01.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:01.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.100 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 30.139897257000001, 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:01.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:01.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:01.104 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:01.106 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:32:01.107 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:01.122+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:01.206 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:01.223+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:01.228 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:01.228 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:32:01.228 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:32:01.228 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:01.237 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:32:01.308 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:01.324+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:01.346 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:01.347 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:32:01.347 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-15T23:32:01.347 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-15T23:32:01.347 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:01.355 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:32:01.409 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:01.426+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:01.467 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:01.529 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.613737715999999, 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016751775999999999, 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.530 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.531 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867736+0000", 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2537999999999999e-05 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867743+0000", 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4279999999999999e-06 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867756+0000", 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2774e-05 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.532 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867783+0000", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7722e-05 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868423+0000", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00063940899999999996 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868430+0000", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7880000000000001e-06 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.533 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876493+0000", 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0080637980000000005 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876624+0000", 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013080599999999999 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877204+0000", 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057935099999999998 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.534 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881649+0000", 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044450940000000001 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884341+0000", 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026923139999999999 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884405+0000", 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4220999999999994e-05 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.535 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884475+0000", 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9533e-05 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:7 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.613123035000001, 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016252260000000001, 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.536 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6000000000000002e-07 2024-04-15T23:32:01.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868345+0000", 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0580000000000003e-06 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868354+0000", 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6059999999999992e-06 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868362+0000", 2024-04-15T23:32:01.538 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1429999999999998e-06 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868677+0000", 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000314383 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868684+0000", 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4320000000000002e-06 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.539 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877636+0000", 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0089513189999999992 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877748+0000", 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111993 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877866+0000", 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000118721 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.540 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881773+0000", 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039063989999999996 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884521+0000", 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027486450000000001 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884558+0000", 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6371000000000001e-05 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.541 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884590+0000", 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2329999999999997e-05 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.613046775000001, 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013223400999999999, 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.542 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868415+0000", 2024-04-15T23:32:01.543 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0500000000000003e-07 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868427+0000", 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.201e-05 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868435+0000", 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1920000000000005e-06 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868445+0000", 2024-04-15T23:32:01.544 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9909999999999997e-06 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868650+0000", 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00020519700000000001 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868657+0000", 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5060000000000001e-06 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875798+0000", 2024-04-15T23:32:01.545 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007141072 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876016+0000", 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000218316 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876164+0000", 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014811300000000001 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.546 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880696+0000", 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045315370000000004 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881556+0000", 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086031699999999998 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.547 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881600+0000", 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4335000000000002e-05 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881637+0000", 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7110000000000002e-05 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.613005208000001, 2024-04-15T23:32:01.548 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013308986, 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.549 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4099999999999998e-07 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868460+0000", 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2740000000000001e-06 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868467+0000", 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3899999999999998e-06 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.550 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868479+0000", 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1951e-05 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868711+0000", 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000232465 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868715+0000", 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1860000000000002e-06 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.551 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876682+0000", 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079668489999999998 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876769+0000", 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6967999999999998e-05 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877143+0000", 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00037359300000000003 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.552 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880775+0000", 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036317979999999999 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881652+0000", 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00087763100000000003 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881715+0000", 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2788999999999998e-05 2024-04-15T23:32:01.553 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881765+0000", 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450999999999998e-05 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.612915068, 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016167357, 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.554 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868547+0000", 2024-04-15T23:32:01.555 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2999999999999999e-07 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868551+0000", 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.848e-06 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868567+0000", 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.5319999999999999e-05 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868575+0000", 2024-04-15T23:32:01.556 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8790000000000003e-06 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017436900000000001 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868761+0000", 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.182e-05 2024-04-15T23:32:01.557 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878325+0000", 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0095639330000000002 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878481+0000", 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015608399999999999 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:01.558 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878620+0000", 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000139288 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881779+0000", 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031593540000000001 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884634+0000", 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0028545049999999998 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.559 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884674+0000", 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9878e-05 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884713+0000", 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9249000000000003e-05 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.560 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.612863090000001, 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015469673, 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.561 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8100000000000002e-07 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868603+0000", 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6770000000000003e-06 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868613+0000", 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5699999999999999e-06 2024-04-15T23:32:01.562 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868620+0000", 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2830000000000004e-06 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869826+0000", 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0012064339999999999 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869832+0000", 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0290000000000002e-06 2024-04-15T23:32:01.563 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874065+0000", 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0042329510000000004 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874220+0000", 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015491699999999999 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874405+0000", 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018499599999999999 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.564 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879828+0000", 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0054231410000000002 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883969+0000", 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041404559999999998 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884024+0000", 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4944000000000001e-05 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.565 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884067+0000", 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3494000000000001e-05 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.612524415999999, 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015273920999999999, 2024-04-15T23:32:01.566 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868937+0000", 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.47e-07 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868947+0000", 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6730000000000004e-06 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868959+0000", 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1956999999999999e-05 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.568 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868968+0000", 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.3009999999999995e-06 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869942+0000", 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00097338899999999996 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869946+0000", 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7550000000000002e-06 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.569 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875078+0000", 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051312529999999997 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000148949 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884210+0000", 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008983797 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.570 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.611606793, 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014939332, 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:01.571 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869855+0000", 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9599999999999998e-07 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869860+0000", 2024-04-15T23:32:01.572 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9779999999999996e-06 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869871+0000", 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1032e-05 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869880+0000", 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9600000000000006e-06 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869979+0000", 2024-04-15T23:32:01.573 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9392e-05 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869983+0000", 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6380000000000002e-06 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879365+0000", 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093823139999999992 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879554+0000", 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018925300000000001 2024-04-15T23:32:01.574 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884793+0000", 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052388690000000002 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.611561132999999, 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.01118678, 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.575 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.576 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8599999999999998e-07 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869903+0000", 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9979999999999999e-06 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869999+0000", 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5710000000000004e-05 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.577 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870008+0000", 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1600000000000004e-06 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870654+0000", 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00064568299999999998 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870660+0000", 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0769999999999996e-06 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.578 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876226+0000", 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055662949999999997 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876342+0000", 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011568700000000001 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881086+0000", 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0047445839999999996 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.579 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.610852161, 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.006624909, 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:01.580 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7399999999999999e-07 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870622+0000", 2024-04-15T23:32:01.581 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2914e-05 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870653+0000", 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0806000000000003e-05 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.582 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:set 4.9 pg_upmap mapping to [0,1] 2024-04-15T23:32:01.584 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:01.600+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:01.584 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:32:01.585 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.585 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870670+0000", 2024-04-15T23:32:01.585 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.694e-05 2024-04-15T23:32:01.585 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.872456+0000", 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017861940000000001 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877234+0000", 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004777781 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.586 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.607783784999999, 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0058784350000000004, 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.587 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.67e-07 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873697+0000", 2024-04-15T23:32:01.588 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9491999999999999e-05 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873708+0000", 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0893999999999999e-05 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873726+0000", 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7999000000000002e-05 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873911+0000", 2024-04-15T23:32:01.589 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018578600000000001 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873936+0000", 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4454999999999999e-05 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879501+0000", 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055647470000000001 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.590 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879555+0000", 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4795e-05 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.603990201999999, 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037213989999999998, 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.591 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.592 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877477+0000", 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3319999999999997e-06 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877486+0000", 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0550000000000005e-06 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.593 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877505+0000", 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8844000000000001e-05 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877620+0000", 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114393 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877639+0000", 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8788e-05 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.594 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881149+0000", 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003510862 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881192+0000", 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2571000000000003e-05 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.603941029000001, 2024-04-15T23:32:01.595 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037611580000000001, 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.596 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.72e-07 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877531+0000", 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.075e-05 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877540+0000", 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8680000000000005e-06 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.597 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877547+0000", 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.3839999999999999e-06 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877942+0000", 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00039470199999999998 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877960+0000", 2024-04-15T23:32:01.598 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8241999999999999e-05 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881250+0000", 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032902949999999999 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881281+0000", 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0545e-05 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.599 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.603903499000001, 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037922429999999998, 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:01.600 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877558+0000", 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1899999999999998e-07 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.601 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877564+0000", 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5409999999999997e-06 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877572+0000", 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5549999999999997e-06 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877579+0000", 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8190000000000003e-06 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.602 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877735+0000", 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000156133 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877754+0000", 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9559e-05 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881307+0000", 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00355296 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.603 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881349+0000", 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2256999999999999e-05 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 3 lcod 14'1)", 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.601119129000001, 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00023478400000000001, 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.604 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:01.605 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2799999999999996e-07 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880346+0000", 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4359999999999998e-06 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880461+0000", 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011513700000000001 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.606 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880470+0000", 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7900000000000005e-06 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880527+0000", 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7095999999999997e-05 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880576+0000", 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9796999999999998e-05 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.607 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.597536069, 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029033999999999999, 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.608 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9400000000000001e-07 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883929+0000", 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9890000000000003e-06 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.609 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883938+0000", 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4640000000000006e-06 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883944+0000", 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8870000000000003e-06 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884099+0000", 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015466199999999999 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.610 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884215+0000", 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115944 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:7 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.597161120999999, 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029787699999999999, 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.611 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9099999999999999e-07 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.612 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884303+0000", 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1240000000000001e-06 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884310+0000", 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1330000000000001e-06 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884317+0000", 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9920000000000001e-06 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.613 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884512+0000", 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00019436900000000001 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884518+0000", 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1770000000000003e-06 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884598+0000", 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9691000000000007e-05 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.614 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 30.597076039000001, 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033810099999999999, 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:01.615 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2600000000000002e-07 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884389+0000", 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8449999999999996e-06 2024-04-15T23:32:01.616 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884398+0000", 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884404+0000", 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0780000000000001e-06 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884623+0000", 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00021912599999999999 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.617 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884630+0000", 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9419999999999998e-06 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884723+0000", 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2597999999999997e-05 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-15T23:32:01.618 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 28.615398174999999, 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052092120000000004, 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:01.619 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866064+0000", 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.813e-06 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866072+0000", 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866085+0000", 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3179e-05 2024-04-15T23:32:01.620 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866091+0000", 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0809999999999999e-06 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866178+0000", 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6945000000000002e-05 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866183+0000", 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4710000000000001e-06 2024-04-15T23:32:01.621 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869710+0000", 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0035276610000000001 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869800+0000", 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0153000000000002e-05 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869885+0000", 2024-04-15T23:32:01.622 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4478e-05 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.870362+0000", 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047698899999999998 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871210+0000", 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00084789999999999996 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871244+0000", 2024-04-15T23:32:01.623 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4561999999999999e-05 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871272+0000", 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7461999999999999e-05 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 9.6133726579999994, 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001586395, 2024-04-15T23:32:01.624 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:01.625 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868089+0000", 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1710000000000001e-06 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868098+0000", 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868115+0000", 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6843000000000001e-05 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.626 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868143+0000", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7512e-05 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868212+0000", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9487999999999996e-05 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868288+0000", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5629000000000004e-05 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:01.627 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868389+0000", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100985 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869162+0000", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00077331800000000005 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869608+0000", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00044655299999999998 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869642+0000", 2024-04-15T23:32:01.628 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4010000000000001e-05 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869674+0000", 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1999999999999999e-05 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:01.629 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:01.631 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:01.684 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:01.701+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:01.750 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:01.750 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:01.750 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:01.750 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:01.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:01.786 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:01.802+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:01.867 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:01.868 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:01.868 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:01.868 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:01.868 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:01.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:01.886 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:01.903+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:01.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:01.986 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.930513898000001, 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:01.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:01.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:01.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:01.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.929821353999998, 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:01.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:01.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.92942944, 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:01.996 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:01.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:01.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.000 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.929094995, 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:02.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.927799641999997, 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:02.005 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:02.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:02.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.009 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.575533778999997, 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:02.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.575310776999999, 2024-04-15T23:32:02.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:02.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:02.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:02.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.574869933999999, 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:02.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.574217977000004, 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:02.023 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:02.027 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.573411710000002, 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:02.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.031 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.571311215999998, 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:02.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:02.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133847138, 2024-04-15T23:32:02.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:02.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:02.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:02.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133790393999998, 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:02.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133679237999999, 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.052 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133592224000001, 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133558523000001, 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:02.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133369984000002, 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.063 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:02.068 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133325765999999, 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:02.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:02.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:02.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133285267000002, 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.133243557, 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:02.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:02.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.081 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:02.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:02.082 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:02.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:02.084 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:02.100+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:02.110 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:02.110 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:02.129 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:02.129 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:02.146 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:32:02.147 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:32:02.184 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:02.200+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:02.198 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:02.198 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:02.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:02.291 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:02.308+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:02.355 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:02.355 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:02.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:02.405 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:02.422+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:02.487 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:02.503+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:02.512 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:02.512 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:02.521 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:32:02.588 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:02.604+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:02.640 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:02.640 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:02.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:32:02.691 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:02.708+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:02.790 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:02.806+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:02.798 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:02.799 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:02.807 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:32:02.890 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:02.907+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:02.917 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:02.917 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:02.926 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:02.991 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:03.008+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:03.039 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.039 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:03.092 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:03.109+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:03.155 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.155 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:03.193 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:03.210+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:03.271 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.272 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:03.294 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:03.311+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:03.393 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.393 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.394 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:03.411+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:03.402 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:03.495 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:03.512+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:03.550 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.550 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.559 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:03.597 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:03.613+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:03.632 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:32:03.668 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.669 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:32:03.697 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:03.714+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:03.795 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.795 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.798 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:03.815+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:03.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:32:03.899 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:03.916+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:03.911 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:03.911 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:03.920 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:32:04.004 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:04.021+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:04.068 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:04.068 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:04.077 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:04.118 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:04.135+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:04.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:04.194 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:04.194 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:04.202 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:04.219+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:04.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:04.285 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:04.285 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:04.303 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:04.303 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:04.303 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:04.320+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:04.312 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:04.312 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:04.312 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:04.312 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:04.312 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:04.321 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:32:04.321 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:32:04.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:04.404 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:04.420+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:04.431 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:04.431 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:04.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:04.431 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.375841878000003, 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:04.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.375149334, 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.374757420000002, 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:04.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:04.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.374422975000002, 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:04.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:04.448 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.373127621999998, 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:04.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.020861758999999, 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.020638757, 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.020197914000001, 2024-04-15T23:32:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.019545956999998, 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.018739689999997, 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.016639196, 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.579175118000002, 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.579118373999997, 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.579007218000001, 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.578920203999999, 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.578886503, 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.578697964, 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.578653746000001, 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.578613247, 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.578571537000002, 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:04.525 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:04.527 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:04.543+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:04.527 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:32:04.528 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:04.627 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:04.643+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:04.638 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:04.639 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:04.639 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:04.639 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:04.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:04.728 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:04.744+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:04.756 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:04.756 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:04.756 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:04.756 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:04.756 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:04.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:04.847 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:04.864+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:04.912 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.858624147, 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:04.913 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:04.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:04.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:04.919 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.858542659000001, 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.920 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:04.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:04.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060450967999998, 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.926 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:04.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:04.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.931 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060402977999999, 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.936 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060364679000003, 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:04.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:04.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:04.942 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060325890999998, 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:04.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:04.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060302559999997, 2024-04-15T23:32:04.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.953 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060272075, 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:04.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:04.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:04.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:04.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060237006000001, 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:04.959 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:04.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:04.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060213263000001, 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:04.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060189004000001, 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.970 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060160664999998, 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060121866000003, 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060086695000003, 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.060053326999999, 2024-04-15T23:32:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.059995866000001, 2024-04-15T23:32:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:05.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:05.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:05.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.058360206000003, 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:05.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:05.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:05.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:05.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.057468673999999, 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:05.011 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.016 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.057417325999999, 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:05.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:05.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.021 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 34.057379210000001, 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:05.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.026 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.026 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:05.026 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:05.026 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:05.027 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:32:05.028 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:05.044+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:05.129 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:05.145+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:05.148 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:05.148 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:32:05.148 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:32:05.148 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:05.157 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:32:05.229 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:05.246+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:05.264 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:32:05.264 INFO:teuthology.orchestra.run.smithi195.stdout: "complaint_time": 30, 2024-04-15T23:32:05.264 INFO:teuthology.orchestra.run.smithi195.stdout: "num_blocked_ops": 0 2024-04-15T23:32:05.264 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:05.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:32:05.330 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:05.347+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout: "size": 20, 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 600, 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [ 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.383 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.531352288000001, 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016751775999999999, 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.384 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867723+0000", 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867736+0000", 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2537999999999999e-05 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867743+0000", 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4279999999999999e-06 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.385 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867756+0000", 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2774e-05 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.867783+0000", 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7722e-05 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868423+0000", 2024-04-15T23:32:05.386 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00063940899999999996 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868430+0000", 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.7880000000000001e-06 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876493+0000", 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0080637980000000005 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876624+0000", 2024-04-15T23:32:05.387 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00013080599999999999 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877204+0000", 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00057935099999999998 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881649+0000", 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0044450940000000001 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884341+0000", 2024-04-15T23:32:05.388 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0026923139999999999 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884405+0000", 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4220999999999994e-05 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884475+0000", 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9533e-05 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.389 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:7 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.530737606999999, 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016252260000000001, 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.390 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868338+0000", 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6000000000000002e-07 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868345+0000", 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0580000000000003e-06 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.391 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868354+0000", 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6059999999999992e-06 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868362+0000", 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1429999999999998e-06 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868677+0000", 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000314383 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.392 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868684+0000", 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.4320000000000002e-06 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877636+0000", 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0089513189999999992 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877748+0000", 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000111993 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.393 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877866+0000", 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000118721 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881773+0000", 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0039063989999999996 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884521+0000", 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0027486450000000001 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.394 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884558+0000", 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6371000000000001e-05 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884590+0000", 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.2329999999999997e-05 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.395 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.530661346999999, 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013223400999999999, 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.396 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868414+0000", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868415+0000", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.0500000000000003e-07 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868427+0000", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.201e-05 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868435+0000", 2024-04-15T23:32:05.397 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.1920000000000005e-06 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868445+0000", 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9909999999999997e-06 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868650+0000", 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00020519700000000001 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868657+0000", 2024-04-15T23:32:05.398 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5060000000000001e-06 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875798+0000", 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.007141072 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876016+0000", 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000218316 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876164+0000", 2024-04-15T23:32:05.399 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00014811300000000001 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880696+0000", 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0045315370000000004 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881556+0000", 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00086031699999999998 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881600+0000", 2024-04-15T23:32:05.400 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4335000000000002e-05 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881637+0000", 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.7110000000000002e-05 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.530619780000002, 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.013308986, 2024-04-15T23:32:05.401 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.402 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868456+0000", 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.4099999999999998e-07 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868460+0000", 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2740000000000001e-06 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868467+0000", 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3899999999999998e-06 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.403 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868479+0000", 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1951e-05 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868711+0000", 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000232465 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868715+0000", 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1860000000000002e-06 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.404 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876682+0000", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0079668489999999998 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876769+0000", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6967999999999998e-05 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877143+0000", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00037359300000000003 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.405 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880775+0000", 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0036317979999999999 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881652+0000", 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00087763100000000003 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881715+0000", 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2788999999999998e-05 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.406 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881765+0000", 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9450999999999998e-05 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.530529639999997, 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.016167357, 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.407 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868546+0000", 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868547+0000", 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.2999999999999999e-07 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.408 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868551+0000", 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.848e-06 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868567+0000", 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.5319999999999999e-05 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868575+0000", 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8790000000000003e-06 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.409 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00017436900000000001 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868761+0000", 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.182e-05 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878325+0000", 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0095639330000000002 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.410 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878481+0000", 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015608399999999999 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.878620+0000", 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000139288 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881779+0000", 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0031593540000000001 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.411 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884634+0000", 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0028545049999999998 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884674+0000", 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9878e-05 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884713+0000", 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9249000000000003e-05 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.412 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:28 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.530477662000003, 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015469673, 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:05.413 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868598+0000", 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.8100000000000002e-07 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868603+0000", 2024-04-15T23:32:05.414 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.6770000000000003e-06 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868613+0000", 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5699999999999999e-06 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868620+0000", 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.2830000000000004e-06 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869826+0000", 2024-04-15T23:32:05.415 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0012064339999999999 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869832+0000", 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0290000000000002e-06 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874065+0000", 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0042329510000000004 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874220+0000", 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015491699999999999 2024-04-15T23:32:05.416 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.874405+0000", 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018499599999999999 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879828+0000", 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0054231410000000002 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883969+0000", 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0041404559999999998 2024-04-15T23:32:05.417 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884024+0000", 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4944000000000001e-05 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884067+0000", 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.3494000000000001e-05 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.418 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.530138987999997, 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.015273920999999999, 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868936+0000", 2024-04-15T23:32:05.419 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868937+0000", 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.47e-07 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868947+0000", 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.6730000000000004e-06 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868959+0000", 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1956999999999999e-05 2024-04-15T23:32:05.420 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.868968+0000", 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.3009999999999995e-06 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869942+0000", 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00097338899999999996 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869946+0000", 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.7550000000000002e-06 2024-04-15T23:32:05.421 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875078+0000", 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0051312529999999997 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000148949 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884210+0000", 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.008983797 2024-04-15T23:32:05.422 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.529221364999998, 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.014939332, 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:05.423 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869854+0000", 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869855+0000", 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9599999999999998e-07 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869860+0000", 2024-04-15T23:32:05.424 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9779999999999996e-06 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869871+0000", 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1032e-05 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869880+0000", 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.9600000000000006e-06 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869979+0000", 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.9392e-05 2024-04-15T23:32:05.425 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting_for_map not empty", 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869983+0000", 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.6380000000000002e-06 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879365+0000", 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0093823139999999992 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879554+0000", 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018925300000000001 2024-04-15T23:32:05.426 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884793+0000", 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052388690000000002 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.529175705, 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.01118678, 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.427 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869900+0000", 2024-04-15T23:32:05.428 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.8599999999999998e-07 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869903+0000", 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.9979999999999999e-06 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.869999+0000", 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.5710000000000004e-05 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870008+0000", 2024-04-15T23:32:05.429 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.1600000000000004e-06 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870654+0000", 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00064568299999999998 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870660+0000", 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0769999999999996e-06 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876226+0000", 2024-04-15T23:32:05.430 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055662949999999997 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.876342+0000", 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011568700000000001 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881086+0000", 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0047445839999999996 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.431 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing(3.1a epoch 14/12 rep_tid 2 entries 14'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.528466733000002, 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.006624909, 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.432 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870609+0000", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7399999999999999e-07 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870622+0000", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.2914e-05 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870653+0000", 2024-04-15T23:32:05.433 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0806000000000003e-05 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.870670+0000", 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.694e-05 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.872456+0000", 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0017861940000000001 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.434 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877234+0000", 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.004777781 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:29 3.13 e14/12 3:cd5a64a3:::100.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.525398357, 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0058784350000000004, 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.435 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873677+0000", 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.67e-07 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.436 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873697+0000", 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9491999999999999e-05 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873708+0000", 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.0893999999999999e-05 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873726+0000", 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.7999000000000002e-05 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.437 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873911+0000", 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00018578600000000001 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.873936+0000", 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.4454999999999999e-05 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879501+0000", 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0055647470000000001 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.438 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.879555+0000", 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.4795e-05 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:20 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'1, mlcod=0'0)", 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.521604773999996, 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037213989999999998, 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.439 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877471+0000", 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:05.440 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877477+0000", 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.3319999999999997e-06 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877486+0000", 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0550000000000005e-06 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877505+0000", 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8844000000000001e-05 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.441 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877620+0000", 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000114393 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877639+0000", 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8788e-05 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881149+0000", 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.003510862 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.442 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881192+0000", 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2571000000000003e-05 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:21 3.1c e14/12 3:3ed09add:::607.00000000:head v 14'2, mlcod=0'0)", 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.521555601000003, 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037611580000000001, 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.443 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877520+0000", 2024-04-15T23:32:05.444 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.72e-07 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877531+0000", 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.075e-05 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877540+0000", 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8680000000000005e-06 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877547+0000", 2024-04-15T23:32:05.445 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.3839999999999999e-06 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877942+0000", 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00039470199999999998 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877960+0000", 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.8241999999999999e-05 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881250+0000", 2024-04-15T23:32:05.446 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0032902949999999999 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881281+0000", 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.0545e-05 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop(mds.0.3:27 3.13 e14/12 3:c91d4a1d:::mds0_inotable:head v 14'2, mlcod=0'0)", 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.521518071000003, 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0037922429999999998, 2024-04-15T23:32:05.447 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877557+0000", 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.448 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877558+0000", 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.1899999999999998e-07 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877564+0000", 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.5409999999999997e-06 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877572+0000", 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5549999999999997e-06 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.449 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877579+0000", 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8190000000000003e-06 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877735+0000", 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000156133 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.877754+0000", 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.9559e-05 2024-04-15T23:32:05.450 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881307+0000", 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00355296 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.881349+0000", 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.2256999999999999e-05 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.451 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.1e epoch 14/12 rep_tid 3 lcod 14'1)", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.518733701000002, 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00023478400000000001, 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:05.452 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880342+0000", 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.2799999999999996e-07 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880346+0000", 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4359999999999998e-06 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880461+0000", 2024-04-15T23:32:05.453 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00011513700000000001 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880470+0000", 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.7900000000000005e-06 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880527+0000", 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 5.7095999999999997e-05 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.880576+0000", 2024-04-15T23:32:05.454 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.9796999999999998e-05 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "pg_update_log_missing_reply(3.b epoch 14/12 rep_tid 1 lcod 14'2)", 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.515150640999998, 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029033999999999999, 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "reached pg", 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.455 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883925+0000", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9400000000000001e-07 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.456 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883929+0000", 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9890000000000003e-06 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883938+0000", 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4640000000000006e-06 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.883944+0000", 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.8870000000000003e-06 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.457 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884099+0000", 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00015466199999999999 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884215+0000", 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000115944 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:7 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:05.458 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.514775692999997, 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00029787699999999999, 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.459 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884300+0000", 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.9099999999999999e-07 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884303+0000", 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1240000000000001e-06 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884310+0000", 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.1330000000000001e-06 2024-04-15T23:32:05.460 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884317+0000", 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9920000000000001e-06 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884512+0000", 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00019436900000000001 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884518+0000", 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.1770000000000003e-06 2024-04-15T23:32:05.461 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884598+0000", 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.9691000000000007e-05 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e14/12 ondisk, result = 0)", 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 34.514690610999999, 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00033810099999999999, 2024-04-15T23:32:05.462 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "started", 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.463 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884385+0000", 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.2600000000000002e-07 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884389+0000", 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.8449999999999996e-06 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884398+0000", 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.464 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884404+0000", 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0780000000000001e-06 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884623+0000", 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00021912599999999999 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884630+0000", 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9419999999999998e-06 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.465 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:30.884723+0000", 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.2597999999999997e-05 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e15)", 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 32.533012747000001, 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0052092120000000004, 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.466 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866063+0000", 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866064+0000", 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.813e-06 2024-04-15T23:32:05.467 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866072+0000", 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5179999999999998e-06 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866085+0000", 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.3179e-05 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866091+0000", 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.0809999999999999e-06 2024-04-15T23:32:05.468 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866178+0000", 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.6945000000000002e-05 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op must wait for map", 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.866183+0000", 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 4.4710000000000001e-06 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869710+0000", 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.0035276610000000001 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.469 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869800+0000", 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 9.0153000000000002e-05 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.869885+0000", 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.4478e-05 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.870362+0000", 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00047698899999999998 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.470 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871210+0000", 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00084789999999999996 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871244+0000", 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4561999999999999e-05 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:32.871272+0000", 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7461999999999999e-05 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.471 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e16)", 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "initiated_at": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "age": 13.530987230000001, 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.001586395, 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "continuous": false, 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "type_data": { 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "events": [ 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "initiated", 2024-04-15T23:32:05.472 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "header_read", 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868088+0000", 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "throttled", 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868089+0000", 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.1710000000000001e-06 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "all_read", 2024-04-15T23:32:05.473 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868098+0000", 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 8.8859999999999993e-06 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "dispatched", 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868115+0000", 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 1.6843000000000001e-05 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868143+0000", 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 2.7512e-05 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "reached_pg", 2024-04-15T23:32:05.474 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868212+0000", 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 6.9487999999999996e-05 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "started", 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868288+0000", 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 7.5629000000000004e-05 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.868389+0000", 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.000100985 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.475 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "op_commit", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869162+0000", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00077331800000000005 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869608+0000", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 0.00044655299999999998 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "commit_sent", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869642+0000", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.4010000000000001e-05 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: { 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "event": "done", 2024-04-15T23:32:05.476 INFO:teuthology.orchestra.run.smithi195.stdout: "time": "2024-04-15T23:31:51.869674+0000", 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout: "duration": 3.1999999999999999e-05 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout: } 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2024-04-15T23:32:05.477 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:05.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:05.479 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:05.495+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:05.579 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:05.595+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:05.599 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:05.599 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:05.608 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:05.679 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:05.697+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:05.716 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:05.717 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:05.717 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:05.717 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:05.717 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:05.725 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:05.781 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:05.797+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:05.835 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.780033303000003, 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:05.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.779340759, 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:05.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.778948845000002, 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.845 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:05.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.778614400000002, 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:05.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:05.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.777319046999999, 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.854 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:05.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:05.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:05.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.425053183999999, 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:05.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:05.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.424830182000001, 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:05.863 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:05.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.424389339000001, 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:05.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.423737381999999, 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.422931114999997, 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:05.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:05.880 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.420830621, 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.884 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.983366543000002, 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:05.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.983309798999997, 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.890 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:05.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.895 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.983198643000001, 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.900 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.983111629, 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:05.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:05.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.983077928, 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:05.906 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:05.911 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.982889389, 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:05.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:05.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:05.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:05.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.982845171000001, 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:05.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.982804672, 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:05.922 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:05.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:05.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.982762962000002, 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:05.926 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:05.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:05.930 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:05.932 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:05.932 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:05.948+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:06.032 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:06.049+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:06.045 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:06.045 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:06.046 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:06.046 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:06.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:06.133 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:06.150+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:06.203 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:06.204 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:06.204 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:06.204 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:06.204 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:06.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:06.234 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:06.251+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:06.323 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:06.323 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:06.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:06.323 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:06.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.269230039999997, 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:06.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:06.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 40.269148551999997, 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:06.330 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:06.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:06.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:06.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.471056861000001, 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:06.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:06.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:06.341 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.471008871000002, 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:06.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470970571999999, 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:06.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470931784000001, 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.352 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:06.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470908453, 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:06.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:06.363 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470877968000003, 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470842898999997, 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:06.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:06.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:06.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:06.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:06.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470819155999997, 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:06.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:06.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:06.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.379 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470794896999998, 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:06.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:06.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470766558000001, 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.385 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:06.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:06.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.390 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470727758999999, 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.395 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470692587999999, 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470659220000002, 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.470601758999997, 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.406 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:06.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:06.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.411 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.468966098999999, 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:06.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:06.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.468074567000002, 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.417 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:06.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:06.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:06.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.422 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.468023219000003, 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:06.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:06.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:06.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:06.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:06.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.429 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.429 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:06.429 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:06.430 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 35.467985102999997, 2024-04-15T23:32:06.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:06.430 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:06.430 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:06.430 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:06.430 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:06.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:06.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:06.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:06.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:06.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:06.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:06.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:06.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:06.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:06.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:06.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:06.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:06.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:06.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:06.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:06.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:06.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:06.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:06.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:06.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:06.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:06.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:06.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:06.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:06.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:06.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:06.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:06.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:06.438 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.439 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.439 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.439 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:06.439 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:06.439 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:06.440 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:06.443 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:32:06.458+0000 7f8d76523640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 31976) UID: 0 2024-04-15T23:32:06.444 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:32:06.529 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:32:06.542 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:06.559+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:06.566 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:32:06.566 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:32:06.566 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:32:06.566 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:32:06.575 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-15T23:32:06.578 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:06.578 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:06.596 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:06.597 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:06.614 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:32:06.614 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:32:06.631 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-15T23:32:06.631 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:06.632 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-04-15T23:32:06.632 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:32:06.632 INFO:teuthology.orchestra.console.smithi195:Power off 2024-04-15T23:32:06.632 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T23:32:06.644 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:06.660+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:06.655 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-04-15T23:32:06.656 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:32:06.682 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-15T23:32:06.684 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:06.684 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:06.693 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-15T23:32:06.745 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:06.761+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:06.801 INFO:teuthology.orchestra.run.smithi195.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:06.801 INFO:teuthology.orchestra.run.smithi195.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:06.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:06.856 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:06.873+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:06.931 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:06.931 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:06.940 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:06.982 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:06.998+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:07.048 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:07.064+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:07.090 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.090 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.099 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:07.149 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:07.166+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:07.247 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.247 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.250 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:07.267+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:07.255 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:07.351 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:07.368+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:07.375 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.376 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:07.452 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:07.468+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:07.492 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.492 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.501 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:07.517 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:32:07.585 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:07.602+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:07.650 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.650 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.653 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:07.670+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:07.658 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:07.754 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:07.771+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:07.768 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.768 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:07.855 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:07.872+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:07.925 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:07.925 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:07.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:07.978 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:07.995+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:08.043 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:08.043 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:08.053 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:08.096 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:08.113+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:08.158 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:08.175+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:08.162 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:08.162 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:08.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:08.259 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:08.276+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:08.320 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:08.320 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:08.329 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:08.360 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:08.377+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:08.438 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:08.439 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:08.446 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:08.491 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:08.508+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:08.555 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:08.556 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:08.562 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:08.579+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:08.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:08.626 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:08.663 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:08.680+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:08.712 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:08.712 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:08.721 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:08.759 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:08.760 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:08.765 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:08.782+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:08.778 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:08.778 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:08.796 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2: {} 2024-04-15T23:32:08.796 INFO:teuthology.orchestra.run.smithi102.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-15T23:32:08.832 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:08.832 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:08.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:08.832 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.776650727000003, 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:08.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:08.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.775958183, 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:08.837 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.775566269000002, 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:08.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.775231824000002, 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.773936470999999, 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.850 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:08.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.421670607999999, 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:08.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:08.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:08.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.421447606000001, 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.421006763000001, 2024-04-15T23:32:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.420354805999999, 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.419548538999997, 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.417448045, 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979983967000003, 2024-04-15T23:32:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979927222999997, 2024-04-15T23:32:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979816067000002, 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979729053, 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979695352, 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979506813, 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979462595000001, 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979422096, 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.979380386000003, 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:08.924 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:08.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:08.926 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:08.942+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.026 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.043+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.037 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:09.037 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:09.037 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:09.038 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:09.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:09.130 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.147+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.195 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:09.195 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:09.196 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:09.196 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:09.196 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:09.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:09.245 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.262+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.329 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.345+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.355 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.301610007000001, 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.356 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:09.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.301528519000001, 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.362 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:09.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:09.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:09.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503436827999998, 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:09.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503388837999999, 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:09.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503350539000003, 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:09.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:09.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503311750999998, 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:09.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:09.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:09.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:09.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503288419999997, 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:09.390 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:09.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:09.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:09.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503257935000001, 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:09.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:09.401 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503222866000002, 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:09.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:09.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503199123000002, 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:09.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.412 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503174864000002, 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:09.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:09.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503146524999998, 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.418 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:09.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:09.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503107726000003, 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:09.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:09.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503072555000003, 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:09.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:09.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.503039186999999, 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:09.435 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:09.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:09.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.502981726000002, 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:09.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:09.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.446 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.501346065999996, 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:09.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.500454533999999, 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:09.452 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:09.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:09.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.500403186, 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:09.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:09.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.463 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 38.500365070000001, 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:09.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:09.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:09.468 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.468 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.468 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.468 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:09.468 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:09.468 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:09.470 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.486+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:09.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:32:09.570 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.587+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.583 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:09.583 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:09.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:09.672 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.688+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:09.699 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:09.700 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:09.708 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:09.773 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:09.789+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:09.818 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:09.818 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:09.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:09.818 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:09.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.762464475000002, 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:09.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.761771930999998, 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.761380017, 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.761045572, 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:09.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:09.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:09.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.759750218999997, 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:09.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:09.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:09.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.407484355999998, 2024-04-15T23:32:09.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:09.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:09.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.844 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.407261353999999, 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:09.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:09.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.406820510999999, 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:09.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:09.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:09.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.406168553999997, 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:09.853 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.405362287000003, 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:09.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:09.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.403261792999999, 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:09.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:09.866 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965797715000001, 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:09.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:09.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965740971000002, 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965629815, 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965542800999998, 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965509099999998, 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965320560999999, 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965276342999999, 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965235843999999, 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.965194134000001, 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:09.912 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:09.913 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:09.914 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:09.930+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.014 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:10.031+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.024 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:10.024 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:10.024 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:10.024 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:10.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:10.118 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:10.135+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.182 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:10.182 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:10.182 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:10.182 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:10.182 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:10.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:10.231 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:10.248+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.318 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:10.335+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.341 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:10.341 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:10.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:10.341 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.287589363999999, 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.342 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:10.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:10.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 44.287507875999999, 2024-04-15T23:32:10.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:10.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:10.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489416185000003, 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.353 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:10.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:10.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489368194999997, 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:10.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:10.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:10.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.363 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489329896000001, 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:10.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489291108000003, 2024-04-15T23:32:10.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:10.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489267777000002, 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:10.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:10.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:10.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:10.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489237291999999, 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:10.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:10.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:10.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489202222999999, 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.390 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.48917848, 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:10.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:10.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:10.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489154221, 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:10.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:10.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:10.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489125882000003, 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:10.401 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:10.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.406 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489087083000001, 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:10.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:10.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.412 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489051912000001, 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:10.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:10.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:10.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.489018543999997, 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.418 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.488961083, 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:10.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:10.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.487325423000001, 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:10.429 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:10.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:10.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:10.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.486433890999997, 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.435 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:10.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.440 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.486382542999998, 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:10.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:10.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 39.486344426999999, 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:10.446 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:10.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:10.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:10.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:10.450 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:10.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:10.452 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:10.468+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:10.513 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:32:10.552 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:10.569+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:10.567 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:10.567 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:10.567 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:10.567 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:10.577 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:10.653 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:10.670+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.682 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:32:10.727 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:10.727 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:10.727 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:10.727 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:10.727 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:10.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:10.778 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:10.795+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:10.793 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-15T23:32:10.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:10.844 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:10.844 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.788694196000002, 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:10.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:10.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.788001651999998, 2024-04-15T23:32:10.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:10.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.787609738, 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:10.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.787275293, 2024-04-15T23:32:10.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.785979939999997, 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:10.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.433714076999998, 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:10.867 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:10.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.433491074999999, 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:10.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:10.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:10.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.433050231999999, 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:10.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.880 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.432398274999997, 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:10.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:10.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.431592008000003, 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.885 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:10.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:10.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.429491513999999, 2024-04-15T23:32:10.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:10.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.992027436000001, 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:10.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:10.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:10.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:10.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991970692000002, 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:10.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:10.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991859536, 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:10.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:10.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991772521999998, 2024-04-15T23:32:10.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:10.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991738820999998, 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:10.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:10.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.921 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991550281999999, 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:10.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:10.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991506063999999, 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:10.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.933 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991465564999999, 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.991423855000001, 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:10.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:10.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:10.942 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:10.942 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:10.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:10.944 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:10.960+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:10.951 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:10.951 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:10.969 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:10.970 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:10.973 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:10.973 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:11.044 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:11.061+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:11.057 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.057 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.066 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:11.145 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:11.162+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:11.174 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.174 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:11.267 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:11.284+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:11.332 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.332 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:11.381 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:11.398+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:11.448 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:11.464+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:11.449 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.449 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:11.550 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:11.567+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:11.607 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.608 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:11.659 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:11.676+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:11.723 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.724 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.732 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:11.777 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:11.794+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:11.841 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.841 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:11.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:11.852 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:11.869+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:11.954 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:11.970+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:11.997 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:11.997 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.006 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:12.054 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.071+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.115 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.116 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:12.168 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.185+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.234 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.234 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.243 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:12.255 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:12.272+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:12.356 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:12.373+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:12.392 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.392 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.402 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:12.457 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.474+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.510 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.510 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:12.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:32:12.559 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.576+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.629 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.630 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.639 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:12.659 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.676+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.746 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.747 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:12.759 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.776+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.860 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:12.877+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:12.863 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.863 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:12.961 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:12.978+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:12.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:12.986 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:12.986 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:12.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:13.062 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:13.079+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:13.101 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:13.102 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:13.103 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:13.103 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:13.103 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:13.103 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:13.103 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:13.112 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:13.120 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:13.120 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:13.120 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:13.123 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:13.124 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:13.196 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:13.213+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.207212388999999, 2024-04-15T23:32:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.206519845000003, 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.206127930999997, 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.205793485999997, 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:13.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:13.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.204498133000001, 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:13.287 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.852232270000002, 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.852009268000003, 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.292 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:13.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:13.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.851568424999996, 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:13.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:13.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:13.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.850916468000001, 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:13.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.850110201, 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:13.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:13.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.848009707000003, 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:13.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:13.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:13.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410545628999998, 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:13.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:13.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410488884999999, 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:13.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:13.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410377728999997, 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:13.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:13.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.333 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410290715000002, 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:13.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:13.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410257014000003, 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:13.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:13.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:13.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410068475000003, 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:13.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:13.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.410024257000003, 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.351 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:13.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:13.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.356 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.409983758000003, 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.409942047999998, 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:13.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:13.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:13.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:13.365 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:13.367 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:13.383+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:13.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:13.467 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:13.484+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:13.478 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:13.478 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:13.478 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:13.478 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:13.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:32:13.570 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:13.587+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:13.635 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:13.635 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:13.635 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:13.635 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:13.636 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:13.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:13.669 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:13.686+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:13.770 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:13.787+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.742186046999997, 2024-04-15T23:32:13.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:13.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:13.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:13.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.742104558999998, 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:13.805 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:13.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:13.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:13.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.944012868000002, 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:13.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:13.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943964878000003, 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:13.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:13.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943926578999999, 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943887791000002, 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.826 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.94386446, 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:13.831 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:13.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:13.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:13.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:13.836 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943833974999997, 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943798905999998, 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:13.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943775162999998, 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:13.847 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:13.852 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943750903999998, 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:13.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.857 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943722565000002, 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:13.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:13.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:13.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:13.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943683765999999, 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943648594999999, 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943615227000002, 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.877 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.943557765999998, 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:13.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.882 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.941922106, 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:13.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:13.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:13.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:13.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.887 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.941030574000003, 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:13.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:13.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:13.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:13.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.940979226000003, 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 42.940941109999997, 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:13.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.901 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:13.902 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:13.902 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:13.903 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:13.920+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:13.903 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:14.004 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:14.021+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:14.012 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:14.012 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:14.012 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:14.012 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:14.021 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:14.106 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:14.123+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:14.169 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:14.170 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:14.170 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:14.170 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:14.170 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:14.177 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:14.219 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:14.235+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:14.307 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:14.324+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:14.327 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:14.327 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.271841701, 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.271149156999996, 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:14.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.270757242999998, 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:14.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.270422797999998, 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:14.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:14.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:14.347 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.269127445000002, 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:14.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:14.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:14.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.916861582000003, 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.352 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:14.356 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.916638579999997, 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:14.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.916197736999997, 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:14.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:14.366 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.915545780000002, 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.914739513000001, 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:14.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:14.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.912639018999997, 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:14.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.380 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.475174940999999, 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:14.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.475118197, 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.392 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.475007040999998, 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:14.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.474920027000003, 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:14.398 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.404 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.474886326000004, 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.474697786999997, 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.474653568999997, 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.474613069999997, 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.474571359999999, 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:14.433 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:14.434 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:14.451+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:14.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:14.535 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:14.552+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:14.548 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:14.548 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:14.548 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:14.557 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:14.636 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:14.652+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:14.665 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:14.665 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:14.665 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:14.665 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:14.665 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:14.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:14.737 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:14.754+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:14.785 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.731156468000002, 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:14.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:14.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:14.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:14.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.731074980000002, 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:14.791 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932983288999999, 2024-04-15T23:32:14.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:14.801 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932935299, 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:14.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:14.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:14.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.806 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932896999999997, 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:14.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:14.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:14.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:14.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932858211999999, 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932834880999998, 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:14.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:14.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932804396000002, 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:14.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932769327000003, 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.827 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.832 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932745584000003, 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:14.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:14.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:14.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932721325000003, 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:14.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:14.841 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:14.842 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932692985999999, 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:14.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:14.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:14.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:14.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932654186999997, 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.848 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:14.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:14.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:14.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932619015999997, 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932585648, 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:14.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:14.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.932528187000003, 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.864 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:14.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.930892526999997, 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.871 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:14.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:14.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.930000995, 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:14.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:14.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:14.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:14.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.929949647000001, 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.880 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:14.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:14.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 43.929911531000002, 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:14.885 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:14.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:14.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:14.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:14.889 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:14.889 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:32:14.900 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:14.916+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:14.900 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:14.999 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-15T23:32:15.000 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:15.016+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:15.012 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:15.012 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:15.012 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:15.012 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:15.021 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:15.100 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-04-15T23:32:15.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-15T23:32:15.101 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:15.117+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:15.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:15.172 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:15.172 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:15.172 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:15.172 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:15.172 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:15.182 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:15.225 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:15.242+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:15.265 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:15.265 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:15.284 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:15.284 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:15.284 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:15.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:15.288 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:15.289 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:15.289 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:15.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:15.342 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:15.359+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:15.404 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:15.421+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:15.409 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:15.409 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:15.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:15.504 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:15.521+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:15.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:32:15.567 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:15.567 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:15.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:15.605 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:15.622+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:15.707 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:15.724+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:15.723 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:15.724 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:15.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:15.808 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:15.825+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:15.844 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:15.844 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:15.852 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:15.937 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:15.954+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:16.002 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.002 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.010 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:16.011 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:16.027+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:16.112 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:16.128+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:16.158 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.158 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:16.211 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:16.228+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:16.278 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.278 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:16.331 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:16.348+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:16.396 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.396 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:16.413 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:16.430+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:16.514 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:16.531+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:16.539 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:32:16.555 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.555 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:16.615 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:16.632+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:16.675 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.675 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.684 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:16.716 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:16.733+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:16.792 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.792 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:16.844 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:16.861+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:16.908 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:16.908 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:16.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:16.918 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:16.935+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:17.019 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.036+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.026 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:17.026 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:17.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:17.119 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.136+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.143 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:17.143 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:17.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:17.220 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.237+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:17.261 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:17.270 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:17.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:17.321 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.337+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.382 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:17.382 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:17.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:17.423 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:17.424 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:17.431 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.448+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.442 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:17.442 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:17.442 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:17.445 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:17.445 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:17.523 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:17.540+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:17.538 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:17.538 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:17.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:17.624 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.640+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.601217599999998, 2024-04-15T23:32:17.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:17.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.661 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.600525056000002, 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:17.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.666 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.600133141999997, 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.671 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.599798696999997, 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:17.676 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.598503344000001, 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.246237481000001, 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:17.685 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.246014479000003, 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.245573636000003, 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:17.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:17.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:17.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.694 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.244921679000001, 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.244115411999999, 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:17.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:17.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.242014918000002, 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804550839999997, 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:17.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:17.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:17.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:17.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804494095999999, 2024-04-15T23:32:17.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.719 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804382939999996, 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:17.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:17.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:17.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:17.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804295926000002, 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804262225000002, 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:17.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:17.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:17.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:17.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:17.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804073686000002, 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.804029468000003, 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.745 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.803988969000002, 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:17.749 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.803947258999997, 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:17.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:17.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:17.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:17.753 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:17.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:17.755 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.771+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.855 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.872+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.866 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:17.868 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:17.868 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:17.868 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:17.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:17.957 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:17.974+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:17.983 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:17.983 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:17.983 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:17.983 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:17.983 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:17.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:18.057 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:18.074+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:18.102 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.048574109999997, 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:18.103 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:18.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:18.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:18.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.048492621999998, 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:18.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:18.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250400931000001, 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:18.114 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:18.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:18.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250352941000003, 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:18.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250314641999999, 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:18.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:18.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:18.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:18.130 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250275854000002, 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250252523, 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:18.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.141 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250222037999997, 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250186968999998, 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:18.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:18.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:18.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250163225999998, 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:18.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250138966999998, 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:18.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:18.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:18.162 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250110628000002, 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250071828999999, 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.168 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:18.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:18.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250036657999999, 2024-04-15T23:32:18.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:18.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.178 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.250003290000002, 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:18.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:18.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:18.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.183 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.249945828999998, 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:18.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:18.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:18.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:18.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.248310169, 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.247418637000003, 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.194 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:18.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:18.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:18.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.247367289000003, 2024-04-15T23:32:18.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:18.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:18.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:18.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 47.247329172999997, 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:18.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:18.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:18.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:18.208 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:18.210 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:18.210 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.226+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.311 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.327+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.321 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:18.321 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:18.321 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:18.321 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:18.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:18.414 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.431+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.479 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:18.479 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:18.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:18.528 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.545+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.554 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:32:18.613 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.630+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:18.637 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.581677083000002, 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:18.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.580984538999999, 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.580592625000001, 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.580258180000001, 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.578962826999998, 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:18.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:18.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:18.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.226696963999999, 2024-04-15T23:32:18.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:18.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.226473962, 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:18.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:18.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:18.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.226033119, 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:18.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:18.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:18.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.225381161999998, 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.224574895000003, 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.222474400999999, 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.785010323000002, 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784953579000003, 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784842423000001, 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784755408999999, 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784721707999999, 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784533168999999, 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784488951, 2024-04-15T23:32:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784448451999999, 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.784406742000002, 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:18.729 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:18.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:18.731 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.747+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.832 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:18.849+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:18.842 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:18.843 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:18.843 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:18.843 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:18.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:18.932 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:18.949+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:18.959 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:18.959 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:18.959 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:18.959 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:18.959 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:18.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:19.033 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:19.049+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:19.118 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:19.118 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.064575226000002, 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:19.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 53.064493738000003, 2024-04-15T23:32:19.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:19.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:19.129 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266402047, 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:19.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:19.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266354057000001, 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:19.135 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.140 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266315757999998, 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:19.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:19.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.26627697, 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.150 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266253638999999, 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:19.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:19.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:19.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266223154000002, 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266188085000003, 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.161 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:19.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266164342000003, 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:19.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:19.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:19.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266140083000003, 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.171 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:19.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:19.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:19.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266111744, 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:19.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266072944999998, 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.181 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:19.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:19.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266037773999997, 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:19.186 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:19.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:19.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.266004406, 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.191 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:19.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:19.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:19.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:19.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.265946945000003, 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.264311284999998, 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.263419753000001, 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.263368405000001, 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 48.263330289000002, 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:19.220 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:19.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:19.222 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:19.238+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:19.322 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:19.338+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:19.332 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:19.333 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:19.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:19.423 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:19.440+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:19.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:19.489 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:19.489 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:19.489 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:19.489 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:19.489 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:19.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:19.524 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:19.541+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:19.552 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:32:19.584 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:19.584 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:19.602 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:19.603 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:19.606 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:19.606 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:19.607 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:19.607 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:19.616 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:19.660 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:19.677+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:19.725 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:19.742+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:19.725 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:19.726 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:19.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:19.826 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:19.843+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:19.883 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:19.883 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:19.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:19.936 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:19.953+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.000 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.009 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:20.053 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:20.070+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:20.119 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.119 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:20.129 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:20.146+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:20.202 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:20.202 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:20.203 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-15T23:32:20.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-15T23:32:20.229 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:20.246+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:20.274 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.274 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:20.330 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:20.347+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:20.392 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.392 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:20.441 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:20.458+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:20.496 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:20.496 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:32:20.496 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 28, 2024-04-15T23:32:20.496 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:32:20.496 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-04-15T23:31:15.484738+0000", 2024-04-15T23:32:20.497 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-04-15T23:32:19.561387+0000", 2024-04-15T23:32:20.497 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-04-15T23:32:10.524116+0000", 2024-04-15T23:32:20.497 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-04-15T23:31:16.326489+0000", 2024-04-15T23:32:20.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-15T23:32:20.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5804032, 2024-04-15T23:32:20.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "nodeep-scrub", 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 4, 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-04-15T23:32:20.498 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 4, 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 3, 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.797113+0000", 2024-04-15T23:32:20.499 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:20.500 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.501 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:20.502 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:20.502 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:20.502 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:20.502 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:20.502 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:20.503 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:20.503 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:20.503 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:20.503 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:20.503 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:20.503 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:20.504 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:20.505 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-04-15T23:32:20.506 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.507 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.948719+0000", 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:20.508 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-04-15T23:32:20.509 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:20.510 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:20.511 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:20.512 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.4900000095367432, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.4900000095367432, 2024-04-15T23:32:20.513 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_metadata", 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:28.382708+0000", 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:20.514 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-04-15T23:32:20.515 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-04-15T23:32:20.516 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-04-15T23:32:20.516 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:20.516 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:20.516 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:20.516 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:20.517 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:20.517 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:20.517 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:20.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.517 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "14", 2024-04-15T23:32:20.517 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:20.518 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:20.518 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:20.518 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:20.518 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:20.518 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:20.518 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:20.519 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:20.519 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:20.519 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:20.519 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:20.519 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:20.520 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:20.521 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:20.521 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:20.521 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:20.521 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:20.521 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:20.521 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:20.522 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:20.522 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:20.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.522 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:20.522 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:20.523 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:20.524 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:20.524 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:20.524 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:20.524 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:20.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_bias": 4, 2024-04-15T23:32:20.524 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 16, 2024-04-15T23:32:20.525 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_priority": 5 2024-04-15T23:32:20.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.525 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:20.525 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:20.525 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": "cephfs" 2024-04-15T23:32:20.526 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.526 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:20.526 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:20.526 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.690000057220459, 2024-04-15T23:32:20.527 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.690000057220459, 2024-04-15T23:32:20.527 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:20.527 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:32:20.527 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:32:20.527 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:20.527 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 4, 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_data", 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:29.186157+0000", 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:20.528 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 64, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 64, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 64, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 64, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 64, 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:20.529 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "15", 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:20.530 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:20.531 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:20.533 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:20.533 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:20.533 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:20.533 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:20.533 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:20.534 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 64, 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "target_size_ratio": 0.89999997615814209 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "data": "cephfs" 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.5800000429153442, 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.5800000429153442, 2024-04-15T23:32:20.535 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.059999942779541, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.059999942779541, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "37ee61ed-86ab-4308-a161-cd2aafcfd4f9", 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:20.536 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6800", 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6801", 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6802", 2024-04-15T23:32:20.538 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6803", 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6806", 2024-04-15T23:32:20.539 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6807", 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.540 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6804", 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6805", 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.107:6801/1269237815", 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.107:6803/1269237815", 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.107:6807/1269237815", 2024-04-15T23:32:20.541 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.107:6805/1269237815", 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "9631dded-d96a-40ad-945d-252291b498da", 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:20.542 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6800", 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6801", 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6802", 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.544 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6803", 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6806", 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6807", 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.546 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6804", 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6805", 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.115:6801/1544615186", 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.115:6803/1544615186", 2024-04-15T23:32:20.547 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.115:6807/1544615186", 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.115:6805/1544615186", 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "45415c3c-3208-4cab-b6d2-75f250746bef", 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 0, 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:20.548 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 24, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6800", 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.549 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6801", 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6802", 2024-04-15T23:32:20.550 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6803", 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6806", 2024-04-15T23:32:20.551 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6807", 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6804", 2024-04-15T23:32:20.552 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6805", 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.553 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.195:6801/2023242123", 2024-04-15T23:32:20.554 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.195:6803/2023242123", 2024-04-15T23:32:20.554 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.195:6807/2023242123", 2024-04-15T23:32:20.554 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.195:6805/2023242123", 2024-04-15T23:32:20.554 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:20.554 INFO:teuthology.orchestra.run.smithi102.stdout: "exists" 2024-04-15T23:32:20.554 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.555 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:20.555 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-04-15T23:32:20.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.555 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:20.555 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:20.556 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:20.556 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:20.556 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:20.556 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:20.556 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.385592+0000", 2024-04-15T23:32:20.556 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:20.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.557 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.557 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:20.557 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:20.557 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.370073+0000", 2024-04-15T23:32:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.559 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.559 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:20.559 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:20.559 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:20.560 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:20.560 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:20.560 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:20.560 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.369726+0000", 2024-04-15T23:32:20.560 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 23 2024-04-15T23:32:20.560 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.561 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:20.561 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-04-15T23:32:20.561 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:20.561 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "4.9", 2024-04-15T23:32:20.561 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:20.561 INFO:teuthology.orchestra.run.smithi102.stdout: 0, 2024-04-15T23:32:20.562 INFO:teuthology.orchestra.run.smithi102.stdout: 1 2024-04-15T23:32:20.562 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:20.562 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.562 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:20.562 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-04-15T23:32:20.562 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-04-15T23:32:20.563 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-04-15T23:32:20.563 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-04-15T23:32:20.563 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-04-15T23:32:20.563 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-04-15T23:32:20.563 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-04-15T23:32:20.564 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-04-15T23:32:20.564 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-04-15T23:32:20.564 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-04-15T23:32:20.564 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-04-15T23:32:20.564 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-04-15T23:32:20.564 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-04-15T23:32:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-04-15T23:32:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-04-15T23:32:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-04-15T23:32:20.565 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-04-15T23:32:20.566 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-04-15T23:32:20.566 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-04-15T23:32:20.566 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-04-15T23:32:20.566 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-04-15T23:32:20.566 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-04-15T23:32:20.567 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-04-15T23:32:20.567 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-04-15T23:32:20.567 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:20.567 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:32:20.569 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:20.585+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:20.571 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.571 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.572 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '60f632e8-f087-41df-a0b6-043b99131bd6', 'created': '2024-04-15T23:31:15.484738+0000', 'modified': '2024-04-15T23:32:19.561387+0000', 'last_up_change': '2024-04-15T23:32:10.524116+0000', 'last_in_change': '2024-04-15T23:31:16.326489+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 1269237815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 1269237815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 1269237815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 1269237815}]}, 'public_addr': '172.21.15.107:6801/1269237815', 'cluster_addr': '172.21.15.107:6803/1269237815', 'heartbeat_back_addr': '172.21.15.107:6807/1269237815', 'heartbeat_front_addr': '172.21.15.107:6805/1269237815', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9631dded-d96a-40ad-945d-252291b498da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 1544615186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 1544615186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 1544615186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 1544615186}]}, 'public_addr': '172.21.15.115:6801/1544615186', 'cluster_addr': '172.21.15.115:6803/1544615186', 'heartbeat_back_addr': '172.21.15.115:6807/1544615186', 'heartbeat_front_addr': '172.21.15.115:6805/1544615186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '45415c3c-3208-4cab-b6d2-75f250746bef', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 24, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 2023242123}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 2023242123}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 2023242123}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 2023242123}]}, 'public_addr': '172.21.15.195:6801/2023242123', 'cluster_addr': '172.21.15.195:6803/2023242123', 'heartbeat_back_addr': '172.21.15.195:6807/2023242123', 'heartbeat_front_addr': '172.21.15.195:6805/2023242123', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.385592+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.370073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.369726+0000', 'dead_epoch': 23}], 'pg_upmap': [{'pgid': '4.9', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-15T23:32:20.573 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-15T23:32:20.573 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:20.669 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:20.686+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:20.682 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.682 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:20.770 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:20.787+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:20.799 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.799 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:20.871 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:20.888+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:20.916 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:20.916 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:20.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:20.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-04-15T23:32:20.972 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:20.989+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:21.073 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:21.090+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:21.074 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:21.074 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:21.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:21.174 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:21.191+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:21.190 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:21.192 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:21.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:21.275 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:21.292+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:21.308 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:21.308 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:21.317 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:21.376 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:21.393+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:21.425 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:21.425 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:21.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:21.476 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:21.493+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:21.541 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:21.542 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:21.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:21.569 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:32:21.594 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:21.611+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:21.607 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:21.659 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:21.659 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:21.668 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:21.710 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:21.726+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:21.761 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:21.762 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:21.762 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:21.766 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:21.767 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:21.778 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:21.795+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:21.818 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:21.818 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:21.827 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:21.878 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:21.895+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:21.937 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:21.937 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:21.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.880999887999998, 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:21.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:21.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:21.942 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.880307344000002, 2024-04-15T23:32:21.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:21.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:21.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:21.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.879915429999997, 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.949 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:21.953 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.879580984999997, 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:21.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.878285632000001, 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:21.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:21.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.526019769000001, 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:21.967 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.525796767000003, 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:21.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:21.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:21.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.525355924000003, 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.524703967000001, 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.980 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:21.980 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:21.980 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.523897699999999, 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:21.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:21.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:21.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.521797206000002, 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:21.985 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:21.989 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.084333127999997, 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:21.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:21.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.084276383999999, 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:21.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.084165228000003, 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.084078214000002, 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:22.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.009 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.084044513000002, 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:22.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:22.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:22.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:22.014 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.083855974000002, 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:22.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:22.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.083811756000003, 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.083771257000002, 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.083729546999997, 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.032 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:22.034 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:22.034 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:22.050+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:22.134 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:22.151+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:22.147 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:22.147 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:22.147 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:22.147 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:22.156 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:22.236 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:22.252+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:22.305 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:22.306 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:22.306 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:22.306 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:22.306 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:22.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:22.359 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:22.376+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:22.427 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.372313296999998, 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:22.428 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:22.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:22.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:22.435 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.372231808999999, 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:22.438 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:22.439 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.440 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:22.441 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.574140118000003, 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.442 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.443 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.444 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:22.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.574092127999997, 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:22.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:22.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:22.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.455 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.574053829, 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:22.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:22.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:22.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:22.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.574015041000003, 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.462 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:22.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:22.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:22.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:22.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:22.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.468 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573991710000001, 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573961224999998, 2024-04-15T23:32:22.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.482 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573926155999999, 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:22.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573902412999999, 2024-04-15T23:32:22.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:22.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573878153999999, 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:22.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:22.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:22.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573849815000003, 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573811016000001, 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.506 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:22.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:22.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:22.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:22.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573775845, 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:22.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573742477000003, 2024-04-15T23:32:22.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.521 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.573685015999999, 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:22.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:22.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:22.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:22.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.526 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.572049356000001, 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:22.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:22.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.571157823999997, 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.536 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.571106475999997, 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.541 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 51.571068359999998, 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:22.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:22.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:22.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:22.545 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:22.547 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:22.564+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:22.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:22.648 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:22.665+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:22.667 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:22.667 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:22.667 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:22.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:22.749 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:22.766+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:22.786 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:22.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:22.823 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:32:22.850 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:22.867+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:22.903 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.848035592999999, 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:22.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.847343049000003, 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:22.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:22.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.846951134999998, 2024-04-15T23:32:22.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:22.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:22.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:22.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.846616689999998, 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.918 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:22.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:22.923 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.845321337000001, 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.924 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:22.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.493055474000002, 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:22.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.933 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.492832472000003, 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:22.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:22.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:22.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.492391628999997, 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:22.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:22.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:22.944 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.491739672000001, 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.949 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.490933405, 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.488832911000003, 2024-04-15T23:32:22.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:22.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:22.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:22.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.051368832999998, 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.959 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.964 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.051312089, 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:22.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.051200932999997, 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:22.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:22.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:22.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.051113919000002, 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.977 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:22.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:22.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:22.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.983 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.051080218000003, 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:22.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:22.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:22.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:22.991 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.050891679000003, 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:22.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:22.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:22.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.050847460999996, 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:22.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:23.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:23.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:23.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.050806962000003, 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:23.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:23.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:23.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.050765251999998, 2024-04-15T23:32:23.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:23.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:23.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:23.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:23.015 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:23.017 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:23.033+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:23.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:23.117 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:23.134+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:23.128 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:23.129 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:23.129 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:23.129 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:23.137 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:23.221 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:23.238+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:23.285 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:23.285 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:23.285 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:23.285 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:23.285 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:23.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:23.319 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:23.336+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:23.420 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:23.437+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:23.443 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:23.443 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.389607050999999, 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.444 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.445 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.446 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.447 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.448 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.389525562999999, 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:23.449 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.450 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.451 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.452 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.453 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591433872000003, 2024-04-15T23:32:23.454 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.455 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:23.457 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:23.458 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.459 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591385881999997, 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.460 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.461 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.462 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:23.463 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.464 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591347583000001, 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.465 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.466 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:23.467 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:23.468 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.469 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591308795000003, 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.470 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.471 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.472 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.473 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.474 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591285464000002, 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.475 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.476 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.477 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.478 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.479 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591254978999999, 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.480 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.481 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:23.482 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:23.483 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.484 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.59121991, 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:23.485 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.486 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:23.487 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.488 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.489 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591196167, 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.490 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.491 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:23.492 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.493 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.494 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:23.495 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591171908, 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.496 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:23.497 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:23.498 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:23.499 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.500 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591143569000003, 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.501 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:23.502 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:23.503 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:23.505 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591104770000001, 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.506 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.507 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:23.508 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:23.509 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.510 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.511 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591069599000001, 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.512 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.513 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.514 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.516 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.591036230999997, 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.59097877, 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.522 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.527 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.589343110000002, 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.532 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.588451577999997, 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.588400229999998, 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.538 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:23.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.543 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 52.588362113999999, 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:23.547 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:23.549 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:23.549 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:23.566+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:23.650 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:23.666+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:23.666 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:23.666 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:23.666 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:23.666 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:23.675 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:23.760 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:23.777+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:23.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:23.824 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:23.824 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:23.824 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:23.824 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:23.824 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:23.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:23.873 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:23.890+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:23.900 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:23.900 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:23.919 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:23.919 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:23.919 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:23.922 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:23.923 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:23.953 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:23.969+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:23.980 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:23.980 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:23.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:24.053 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:24.071+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:24.101 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.101 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:24.154 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:24.171+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:24.217 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.218 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:24.267 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:24.284+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:24.356 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:24.373+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:24.375 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.375 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:24.458 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:24.474+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:24.494 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.494 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.503 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:24.587 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:24.604+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:24.651 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.651 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.658 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:24.675+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:24.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:24.759 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:24.776+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:24.808 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.808 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.816 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:24.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:32:24.860 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:24.877+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:24.926 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:24.926 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:24.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:24.961 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:24.979+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:25.062 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:25.079+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:25.084 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.084 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.093 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:25.176 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:25.193+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:25.240 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.240 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:25.290 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:25.307+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:25.360 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.360 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.366 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:25.382+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:25.368 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:25.467 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:25.483+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:25.516 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.517 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:25.567 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:25.584+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:25.573 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:25.573 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:25.574 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-15T23:32:25.574 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-15T23:32:25.669 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:25.686+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:25.674 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.674 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:25.770 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:25.787+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:25.795 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.795 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:25.829 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:32:25.871 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:25.887+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:25.876 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:25.876 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 30, 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-04-15T23:31:15.484738+0000", 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-04-15T23:32:25.840273+0000", 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-04-15T23:32:10.524116+0000", 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-04-15T23:31:16.326489+0000", 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5801984, 2024-04-15T23:32:25.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "noscrub", 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 4, 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 4, 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 3, 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-04-15T23:32:25.878 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.797113+0000", 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:25.879 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:25.880 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:25.881 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:25.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-04-15T23:32:25.883 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:25.884 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.948719+0000", 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:25.885 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:25.886 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:25.887 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:25.888 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:25.889 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.4900000095367432, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.4900000095367432, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:25.890 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_metadata", 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:28.382708+0000", 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:25.891 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.892 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "14", 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:25.893 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:25.894 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:25.895 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_bias": 4, 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 16, 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_priority": 5 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": "cephfs" 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.690000057220459, 2024-04-15T23:32:25.896 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.690000057220459, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 4, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_data", 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:29.186157+0000", 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:25.897 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 64, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 64, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 64, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 64, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 64, 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:25.898 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "15", 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:25.899 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:25.900 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:25.901 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 64, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "target_size_ratio": 0.89999997615814209 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "data": "cephfs" 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.5800000429153442, 2024-04-15T23:32:25.902 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.5800000429153442, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.059999942779541, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.059999942779541, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "37ee61ed-86ab-4308-a161-cd2aafcfd4f9", 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:25.903 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6800", 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.904 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6801", 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6802", 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.905 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6803", 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6806", 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.906 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6807", 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6804", 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6805", 2024-04-15T23:32:25.907 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.107:6801/1269237815", 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.107:6803/1269237815", 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.107:6807/1269237815", 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.107:6805/1269237815", 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:25.908 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "9631dded-d96a-40ad-945d-252291b498da", 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.909 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6800", 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6801", 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.910 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6802", 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6803", 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6806", 2024-04-15T23:32:25.911 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6807", 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6804", 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6805", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.115:6801/1544615186", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.115:6803/1544615186", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.115:6807/1544615186", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.115:6805/1544615186", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:25.913 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "45415c3c-3208-4cab-b6d2-75f250746bef", 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 0, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 24, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:25.914 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6800", 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6801", 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:25.915 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6802", 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6803", 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.916 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6806", 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6807", 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.917 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6804", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6805", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.195:6801/2023242123", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.195:6803/2023242123", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.195:6807/2023242123", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.195:6805/2023242123", 2024-04-15T23:32:25.918 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "exists" 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.385592+0000", 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:25.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.370073+0000", 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:25.920 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.369726+0000", 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 23 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "4.9", 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: 0, 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: 1 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:25.921 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:25.922 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:25.923 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:32:25.924 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:25.925 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:25.926 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:25.926 INFO:tasks.thrashosds.thrasher:j is {'epoch': 30, 'fsid': '60f632e8-f087-41df-a0b6-043b99131bd6', 'created': '2024-04-15T23:31:15.484738+0000', 'modified': '2024-04-15T23:32:25.840273+0000', 'last_up_change': '2024-04-15T23:32:10.524116+0000', 'last_in_change': '2024-04-15T23:31:16.326489+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 1269237815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 1269237815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 1269237815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 1269237815}]}, 'public_addr': '172.21.15.107:6801/1269237815', 'cluster_addr': '172.21.15.107:6803/1269237815', 'heartbeat_back_addr': '172.21.15.107:6807/1269237815', 'heartbeat_front_addr': '172.21.15.107:6805/1269237815', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9631dded-d96a-40ad-945d-252291b498da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 1544615186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 1544615186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 1544615186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 1544615186}]}, 'public_addr': '172.21.15.115:6801/1544615186', 'cluster_addr': '172.21.15.115:6803/1544615186', 'heartbeat_back_addr': '172.21.15.115:6807/1544615186', 'heartbeat_front_addr': '172.21.15.115:6805/1544615186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '45415c3c-3208-4cab-b6d2-75f250746bef', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 24, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 2023242123}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 2023242123}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 2023242123}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 2023242123}]}, 'public_addr': '172.21.15.195:6801/2023242123', 'cluster_addr': '172.21.15.195:6803/2023242123', 'heartbeat_back_addr': '172.21.15.195:6807/2023242123', 'heartbeat_front_addr': '172.21.15.195:6805/2023242123', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.385592+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.370073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.369726+0000', 'dead_epoch': 23}], 'pg_upmap': [{'pgid': '4.9', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-15T23:32:25.927 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:32:25.927 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:25.971 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:25.988+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.072 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:26.089+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.075 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:26.075 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:26.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:26.106 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:26.106 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:26.124 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:26.125 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:26.125 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:26.128 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:26.128 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:26.172 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:26.189+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.195 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:26.196 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:26.204 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:26.283 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:26.285 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:32:26.288 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:26.305+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.293 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-15T23:32:25.844986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":99604,"kb_used_data":1904,"kb_used_omap":4,"kb_used_meta":97659,"kb_avail":283015916,"statfs":{"total":289910292480,"available":289808297984,"internally_reserved":0,"allocated":1949696,"data_stored":1489256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":100003151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.269104"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388786+0000","last_change":"2024-04-15T23:32:11.544352+0000","last_active":"2024-04-15T23:32:23.388786+0000","last_peered":"2024-04-15T23:32:23.388786+0000","last_clean":"2024-04-15T23:32:07.534338+0000","last_became_active":"2024-04-15T23:32:11.544352+0000","last_became_peered":"2024-04-15T23:32:11.544352+0000","last_unstale":"2024-04-15T23:32:23.388786+0000","last_undegraded":"2024-04-15T23:32:23.388786+0000","last_fullsized":"2024-04-15T23:32:11.541160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:46:57.018356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387943+0000","last_change":"2024-04-15T23:32:11.543124+0000","last_active":"2024-04-15T23:32:23.387943+0000","last_peered":"2024-04-15T23:32:23.387943+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:32:11.543124+0000","last_became_peered":"2024-04-15T23:32:11.543124+0000","last_unstale":"2024-04-15T23:32:23.387943+0000","last_undegraded":"2024-04-15T23:32:23.387943+0000","last_fullsized":"2024-04-15T23:32:11.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:17:30.568231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.840745+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:32:22.840745+0000","last_peered":"2024-04-15T23:32:22.840745+0000","last_clean":"2024-04-15T23:32:22.840745+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:32:22.840745+0000","last_undegraded":"2024-04-15T23:32:22.840745+0000","last_fullsized":"2024-04-15T23:32:22.840745+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840758+0000","last_change":"2024-04-15T23:32:11.545419+0000","last_active":"2024-04-15T23:32:22.840758+0000","last_peered":"2024-04-15T23:32:22.840758+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:32:11.545419+0000","last_became_peered":"2024-04-15T23:32:11.545419+0000","last_unstale":"2024-04-15T23:32:22.840758+0000","last_undegraded":"2024-04-15T23:32:22.840758+0000","last_fullsized":"2024-04-15T23:32:11.542769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:34.901699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387900+0000","last_change":"2024-04-15T23:32:11.543474+0000","last_active":"2024-04-15T23:32:23.387900+0000","last_peered":"2024-04-15T23:32:23.387900+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:32:11.543474+0000","last_became_peered":"2024-04-15T23:32:11.543474+0000","last_unstale":"2024-04-15T23:32:23.387900+0000","last_undegraded":"2024-04-15T23:32:23.387900+0000","last_fullsized":"2024-04-15T23:32:11.540447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840371+0000","last_change":"2024-04-15T23:32:11.545668+0000","last_active":"2024-04-15T23:32:22.840371+0000","last_peered":"2024-04-15T23:32:22.840371+0000","last_clean":"2024-04-15T23:32:07.786325+0000","last_became_active":"2024-04-15T23:32:11.545668+0000","last_became_peered":"2024-04-15T23:32:11.545668+0000","last_unstale":"2024-04-15T23:32:22.840371+0000","last_undegraded":"2024-04-15T23:32:22.840371+0000","last_fullsized":"2024-04-15T23:32:11.542733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:01.936327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840748+0000","last_change":"2024-04-15T23:32:11.546347+0000","last_active":"2024-04-15T23:32:22.840748+0000","last_peered":"2024-04-15T23:32:22.840748+0000","last_clean":"2024-04-15T23:32:07.786350+0000","last_became_active":"2024-04-15T23:32:11.546347+0000","last_became_peered":"2024-04-15T23:32:11.546347+0000","last_unstale":"2024-04-15T23:32:22.840748+0000","last_undegraded":"2024-04-15T23:32:22.840748+0000","last_fullsized":"2024-04-15T23:32:11.543107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:17.236231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840246+0000","last_change":"2024-04-15T23:32:11.545203+0000","last_active":"2024-04-15T23:32:22.840246+0000","last_peered":"2024-04-15T23:32:22.840246+0000","last_clean":"2024-04-15T23:32:07.786081+0000","last_became_active":"2024-04-15T23:32:11.545203+0000","last_became_peered":"2024-04-15T23:32:11.545203+0000","last_unstale":"2024-04-15T23:32:22.840246+0000","last_undegraded":"2024-04-15T23:32:22.840246+0000","last_fullsized":"2024-04-15T23:32:11.542426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:27:36.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.389066+0000","last_change":"2024-04-15T23:32:11.545953+0000","last_active":"2024-04-15T23:32:23.389066+0000","last_peered":"2024-04-15T23:32:23.389066+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545953+0000","last_became_peered":"2024-04-15T23:32:11.545953+0000","last_unstale":"2024-04-15T23:32:23.389066+0000","last_undegraded":"2024-04-15T23:32:23.389066+0000","last_fullsized":"2024-04-15T23:32:11.541547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:55.363242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387982+0000","last_change":"2024-04-15T23:32:11.543541+0000","last_active":"2024-04-15T23:32:23.387982+0000","last_peered":"2024-04-15T23:32:23.387982+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:32:11.543541+0000","last_became_peered":"2024-04-15T23:32:11.543541+0000","last_unstale":"2024-04-15T23:32:23.387982+0000","last_undegraded":"2024-04-15T23:32:23.387982+0000","last_fullsized":"2024-04-15T23:32:11.541225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:18.524235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841087+0000","last_change":"2024-04-15T23:32:11.545422+0000","last_active":"2024-04-15T23:32:22.841087+0000","last_peered":"2024-04-15T23:32:22.841087+0000","last_clean":"2024-04-15T23:32:07.786647+0000","last_became_active":"2024-04-15T23:32:11.545422+0000","last_became_peered":"2024-04-15T23:32:11.545422+0000","last_unstale":"2024-04-15T23:32:22.841087+0000","last_undegraded":"2024-04-15T23:32:22.841087+0000","last_fullsized":"2024-04-15T23:32:11.543014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:53:35.957069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388075+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:32:23.388075+0000","last_peered":"2024-04-15T23:32:23.388075+0000","last_clean":"2024-04-15T23:32:23.388075+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:32:23.388075+0000","last_undegraded":"2024-04-15T23:32:23.388075+0000","last_fullsized":"2024-04-15T23:32:23.388075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387609+0000","last_change":"2024-04-15T23:32:11.543005+0000","last_active":"2024-04-15T23:32:23.387609+0000","last_peered":"2024-04-15T23:32:23.387609+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:32:11.543005+0000","last_became_peered":"2024-04-15T23:32:11.543005+0000","last_unstale":"2024-04-15T23:32:23.387609+0000","last_undegraded":"2024-04-15T23:32:23.387609+0000","last_fullsized":"2024-04-15T23:32:11.540304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:35:52.653842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.840415+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:32:22.840415+0000","last_peered":"2024-04-15T23:32:22.840415+0000","last_clean":"2024-04-15T23:32:22.840415+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:32:22.840415+0000","last_undegraded":"2024-04-15T23:32:22.840415+0000","last_fullsized":"2024-04-15T23:32:22.840415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.840935+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:32:22.840935+0000","last_peered":"2024-04-15T23:32:22.840935+0000","last_clean":"2024-04-15T23:32:22.840935+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:32:22.840935+0000","last_undegraded":"2024-04-15T23:32:22.840935+0000","last_fullsized":"2024-04-15T23:32:22.840935+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840456+0000","last_change":"2024-04-15T23:32:11.546233+0000","last_active":"2024-04-15T23:32:22.840456+0000","last_peered":"2024-04-15T23:32:22.840456+0000","last_clean":"2024-04-15T23:32:07.786096+0000","last_became_active":"2024-04-15T23:32:11.546233+0000","last_became_peered":"2024-04-15T23:32:11.546233+0000","last_unstale":"2024-04-15T23:32:22.840456+0000","last_undegraded":"2024-04-15T23:32:22.840456+0000","last_fullsized":"2024-04-15T23:32:11.542583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:41.677401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388554+0000","last_change":"2024-04-15T23:32:11.543951+0000","last_active":"2024-04-15T23:32:23.388554+0000","last_peered":"2024-04-15T23:32:23.388554+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543951+0000","last_became_peered":"2024-04-15T23:32:11.543951+0000","last_unstale":"2024-04-15T23:32:23.388554+0000","last_undegraded":"2024-04-15T23:32:23.388554+0000","last_fullsized":"2024-04-15T23:32:11.540820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:22:51.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388757+0000","last_change":"2024-04-15T23:32:11.546238+0000","last_active":"2024-04-15T23:32:23.388757+0000","last_peered":"2024-04-15T23:32:23.388757+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:32:11.546238+0000","last_became_peered":"2024-04-15T23:32:11.546238+0000","last_unstale":"2024-04-15T23:32:23.388757+0000","last_undegraded":"2024-04-15T23:32:23.388757+0000","last_fullsized":"2024-04-15T23:32:11.541553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:51:42.570150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387794+0000","last_change":"2024-04-15T23:32:11.546015+0000","last_active":"2024-04-15T23:32:23.387794+0000","last_peered":"2024-04-15T23:32:23.387794+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:32:23.387794+0000","last_undegraded":"2024-04-15T23:32:23.387794+0000","last_fullsized":"2024-04-15T23:32:11.541074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:30.047705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840746+0000","last_change":"2024-04-15T23:32:11.546261+0000","last_active":"2024-04-15T23:32:22.840746+0000","last_peered":"2024-04-15T23:32:22.840746+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:32:11.546261+0000","last_became_peered":"2024-04-15T23:32:11.546261+0000","last_unstale":"2024-04-15T23:32:22.840746+0000","last_undegraded":"2024-04-15T23:32:22.840746+0000","last_fullsized":"2024-04-15T23:32:11.542768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:24:53.954892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841284+0000","last_change":"2024-04-15T23:32:11.545687+0000","last_active":"2024-04-15T23:32:22.841284+0000","last_peered":"2024-04-15T23:32:22.841284+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:32:11.545687+0000","last_became_peered":"2024-04-15T23:32:11.545687+0000","last_unstale":"2024-04-15T23:32:22.841284+0000","last_undegraded":"2024-04-15T23:32:22.841284+0000","last_fullsized":"2024-04-15T23:32:11.543335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:35:52.653842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387637+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:32:23.387637+0000","last_peered":"2024-04-15T23:32:23.387637+0000","last_clean":"2024-04-15T23:32:23.387637+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:32:23.387637+0000","last_undegraded":"2024-04-15T23:32:23.387637+0000","last_fullsized":"2024-04-15T23:32:23.387637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840214+0000","last_change":"2024-04-15T23:32:11.543830+0000","last_active":"2024-04-15T23:32:22.840214+0000","last_peered":"2024-04-15T23:32:22.840214+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543830+0000","last_became_peered":"2024-04-15T23:32:11.543830+0000","last_unstale":"2024-04-15T23:32:22.840214+0000","last_undegraded":"2024-04-15T23:32:22.840214+0000","last_fullsized":"2024-04-15T23:32:11.542394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:14.580653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387343+0000","last_change":"2024-04-15T23:32:11.541949+0000","last_active":"2024-04-15T23:32:23.387343+0000","last_peered":"2024-04-15T23:32:23.387343+0000","last_clean":"2024-04-15T23:32:07.533578+0000","last_became_active":"2024-04-15T23:32:11.541949+0000","last_became_peered":"2024-04-15T23:32:11.541949+0000","last_unstale":"2024-04-15T23:32:23.387343+0000","last_undegraded":"2024-04-15T23:32:23.387343+0000","last_fullsized":"2024-04-15T23:32:11.539550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:40:09.112117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388960+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:32:23.388960+0000","last_peered":"2024-04-15T23:32:23.388960+0000","last_clean":"2024-04-15T23:32:23.388960+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:32:23.388960+0000","last_undegraded":"2024-04-15T23:32:23.388960+0000","last_fullsized":"2024-04-15T23:32:23.388960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841313+0000","last_change":"2024-04-15T23:32:11.548257+0000","last_active":"2024-04-15T23:32:22.841313+0000","last_peered":"2024-04-15T23:32:22.841313+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:32:22.841313+0000","last_undegraded":"2024-04-15T23:32:22.841313+0000","last_fullsized":"2024-04-15T23:32:11.544630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:29:48.946199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841241+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:32:22.841241+0000","last_peered":"2024-04-15T23:32:22.841241+0000","last_clean":"2024-04-15T23:32:22.841241+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:32:22.841241+0000","last_undegraded":"2024-04-15T23:32:22.841241+0000","last_fullsized":"2024-04-15T23:32:22.841241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388559+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:32:23.388559+0000","last_peered":"2024-04-15T23:32:23.388559+0000","last_clean":"2024-04-15T23:32:23.388559+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:32:23.388559+0000","last_undegraded":"2024-04-15T23:32:23.388559+0000","last_fullsized":"2024-04-15T23:32:23.388559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387487+0000","last_change":"2024-04-15T23:32:11.541839+0000","last_active":"2024-04-15T23:32:23.387487+0000","last_peered":"2024-04-15T23:32:23.387487+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.541839+0000","last_became_peered":"2024-04-15T23:32:11.541839+0000","last_unstale":"2024-04-15T23:32:23.387487+0000","last_undegraded":"2024-04-15T23:32:23.387487+0000","last_fullsized":"2024-04-15T23:32:11.539929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:09:23.261218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387796+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:32:23.387796+0000","last_peered":"2024-04-15T23:32:23.387796+0000","last_clean":"2024-04-15T23:32:23.387796+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:32:23.387796+0000","last_undegraded":"2024-04-15T23:32:23.387796+0000","last_fullsized":"2024-04-15T23:32:23.387796+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387350+0000","last_change":"2024-04-15T23:32:11.542084+0000","last_active":"2024-04-15T23:32:23.387350+0000","last_peered":"2024-04-15T23:32:23.387350+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542084+0000","last_became_peered":"2024-04-15T23:32:11.542084+0000","last_unstale":"2024-04-15T23:32:23.387350+0000","last_undegraded":"2024-04-15T23:32:23.387350+0000","last_fullsized":"2024-04-15T23:32:11.539539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:14.580653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840478+0000","last_change":"2024-04-15T23:32:11.545613+0000","last_active":"2024-04-15T23:32:22.840478+0000","last_peered":"2024-04-15T23:32:22.840478+0000","last_clean":"2024-04-15T23:32:07.786183+0000","last_became_active":"2024-04-15T23:32:11.545613+0000","last_became_peered":"2024-04-15T23:32:11.545613+0000","last_unstale":"2024-04-15T23:32:22.840478+0000","last_undegraded":"2024-04-15T23:32:22.840478+0000","last_fullsized":"2024-04-15T23:32:11.542669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:04.145901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388287+0000","last_change":"2024-04-15T23:32:11.543993+0000","last_active":"2024-04-15T23:32:23.388287+0000","last_peered":"2024-04-15T23:32:23.388287+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:32:11.543993+0000","last_became_peered":"2024-04-15T23:32:11.543993+0000","last_unstale":"2024-04-15T23:32:23.388287+0000","last_undegraded":"2024-04-15T23:32:23.388287+0000","last_fullsized":"2024-04-15T23:32:11.540623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:27.827081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":46,"reported_epoch":29,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:22.841363+0000","last_change":"2024-04-15T23:32:11.547544+0000","last_active":"2024-04-15T23:32:22.841363+0000","last_peered":"2024-04-15T23:32:22.841363+0000","last_clean":"2024-04-15T23:32:07.786667+0000","last_became_active":"2024-04-15T23:32:11.547544+0000","last_became_peered":"2024-04-15T23:32:11.547544+0000","last_unstale":"2024-04-15T23:32:22.841363+0000","last_undegraded":"2024-04-15T23:32:11.543672+0000","last_fullsized":"2024-04-15T23:32:11.543587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:40.606451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388180+0000","last_change":"2024-04-15T23:32:11.543376+0000","last_active":"2024-04-15T23:32:23.388180+0000","last_peered":"2024-04-15T23:32:23.388180+0000","last_clean":"2024-04-15T23:32:07.534221+0000","last_became_active":"2024-04-15T23:32:11.543376+0000","last_became_peered":"2024-04-15T23:32:11.543376+0000","last_unstale":"2024-04-15T23:32:23.388180+0000","last_undegraded":"2024-04-15T23:32:23.388180+0000","last_fullsized":"2024-04-15T23:32:11.541450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:45:42.857925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840616+0000","last_change":"2024-04-15T23:32:11.546441+0000","last_active":"2024-04-15T23:32:22.840616+0000","last_peered":"2024-04-15T23:32:22.840616+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.546441+0000","last_became_peered":"2024-04-15T23:32:11.546441+0000","last_unstale":"2024-04-15T23:32:22.840616+0000","last_undegraded":"2024-04-15T23:32:22.840616+0000","last_fullsized":"2024-04-15T23:32:11.543536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:29.042475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840859+0000","last_change":"2024-04-15T23:32:11.546377+0000","last_active":"2024-04-15T23:32:22.840859+0000","last_peered":"2024-04-15T23:32:22.840859+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546377+0000","last_became_peered":"2024-04-15T23:32:11.546377+0000","last_unstale":"2024-04-15T23:32:22.840859+0000","last_undegraded":"2024-04-15T23:32:22.840859+0000","last_fullsized":"2024-04-15T23:32:11.543483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:22:51.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387550+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:32:23.387550+0000","last_peered":"2024-04-15T23:32:23.387550+0000","last_clean":"2024-04-15T23:32:23.387550+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:32:23.387550+0000","last_undegraded":"2024-04-15T23:32:23.387550+0000","last_fullsized":"2024-04-15T23:32:23.387550+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840951+0000","last_change":"2024-04-15T23:32:11.547018+0000","last_active":"2024-04-15T23:32:22.840951+0000","last_peered":"2024-04-15T23:32:22.840951+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547018+0000","last_became_peered":"2024-04-15T23:32:11.547018+0000","last_unstale":"2024-04-15T23:32:22.840951+0000","last_undegraded":"2024-04-15T23:32:22.840951+0000","last_fullsized":"2024-04-15T23:32:11.543473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:46:57.018356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.840674+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:32:22.840674+0000","last_peered":"2024-04-15T23:32:22.840674+0000","last_clean":"2024-04-15T23:32:22.840674+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:32:22.840674+0000","last_undegraded":"2024-04-15T23:32:22.840674+0000","last_fullsized":"2024-04-15T23:32:22.840674+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841863+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:32:22.841863+0000","last_peered":"2024-04-15T23:32:22.841863+0000","last_clean":"2024-04-15T23:32:22.841863+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:32:22.841863+0000","last_undegraded":"2024-04-15T23:32:22.841863+0000","last_fullsized":"2024-04-15T23:32:22.841863+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387390+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:32:23.387390+0000","last_peered":"2024-04-15T23:32:23.387390+0000","last_clean":"2024-04-15T23:32:23.387390+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:32:23.387390+0000","last_undegraded":"2024-04-15T23:32:23.387390+0000","last_fullsized":"2024-04-15T23:32:23.387390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388802+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:32:23.388802+0000","last_peered":"2024-04-15T23:32:23.388802+0000","last_clean":"2024-04-15T23:32:23.388802+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:32:23.388802+0000","last_undegraded":"2024-04-15T23:32:23.388802+0000","last_fullsized":"2024-04-15T23:32:23.388802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387408+0000","last_change":"2024-04-15T23:32:03.783205+0000","last_active":"2024-04-15T23:32:23.387408+0000","last_peered":"2024-04-15T23:32:23.387408+0000","last_clean":"2024-04-15T23:32:23.387408+0000","last_became_active":"2024-04-15T23:32:03.782934+0000","last_became_peered":"2024-04-15T23:32:03.782934+0000","last_unstale":"2024-04-15T23:32:23.387408+0000","last_undegraded":"2024-04-15T23:32:23.387408+0000","last_fullsized":"2024-04-15T23:32:23.387408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:48:35.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841931+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:32:22.841931+0000","last_peered":"2024-04-15T23:32:22.841931+0000","last_clean":"2024-04-15T23:32:22.841931+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:32:22.841931+0000","last_undegraded":"2024-04-15T23:32:22.841931+0000","last_fullsized":"2024-04-15T23:32:22.841931+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840785+0000","last_change":"2024-04-15T23:32:11.547212+0000","last_active":"2024-04-15T23:32:22.840785+0000","last_peered":"2024-04-15T23:32:22.840785+0000","last_clean":"2024-04-15T23:32:07.786434+0000","last_became_active":"2024-04-15T23:32:11.547212+0000","last_became_peered":"2024-04-15T23:32:11.547212+0000","last_unstale":"2024-04-15T23:32:22.840785+0000","last_undegraded":"2024-04-15T23:32:22.840785+0000","last_fullsized":"2024-04-15T23:32:11.543397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:21.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841750+0000","last_change":"2024-04-15T23:32:11.547400+0000","last_active":"2024-04-15T23:32:22.841750+0000","last_peered":"2024-04-15T23:32:22.841750+0000","last_clean":"2024-04-15T23:32:07.786794+0000","last_became_active":"2024-04-15T23:32:11.547400+0000","last_became_peered":"2024-04-15T23:32:11.547400+0000","last_unstale":"2024-04-15T23:32:22.841750+0000","last_undegraded":"2024-04-15T23:32:22.841750+0000","last_fullsized":"2024-04-15T23:32:11.543649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:18.237296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840380+0000","last_change":"2024-04-15T23:32:11.545235+0000","last_active":"2024-04-15T23:32:22.840380+0000","last_peered":"2024-04-15T23:32:22.840380+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545235+0000","last_became_peered":"2024-04-15T23:32:11.545235+0000","last_unstale":"2024-04-15T23:32:22.840380+0000","last_undegraded":"2024-04-15T23:32:22.840380+0000","last_fullsized":"2024-04-15T23:32:11.542558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:57:44.698682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":26,"reported_epoch":29,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:22.840947+0000","last_change":"2024-04-15T23:32:11.548140+0000","last_active":"2024-04-15T23:32:22.840947+0000","last_peered":"2024-04-15T23:32:22.840947+0000","last_clean":"2024-04-15T23:31:30.873548+0000","last_became_active":"2024-04-15T23:32:11.548140+0000","last_became_peered":"2024-04-15T23:32:11.548140+0000","last_unstale":"2024-04-15T23:32:22.840947+0000","last_undegraded":"2024-04-15T23:32:11.544200+0000","last_fullsized":"2024-04-15T23:32:11.543310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:13:05.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840998+0000","last_change":"2024-04-15T23:32:11.545650+0000","last_active":"2024-04-15T23:32:22.840998+0000","last_peered":"2024-04-15T23:32:22.840998+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:32:11.545650+0000","last_became_peered":"2024-04-15T23:32:11.545650+0000","last_unstale":"2024-04-15T23:32:22.840998+0000","last_undegraded":"2024-04-15T23:32:22.840998+0000","last_fullsized":"2024-04-15T23:32:11.543190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:45:42.857925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841097+0000","last_change":"2024-04-15T23:32:11.548343+0000","last_active":"2024-04-15T23:32:22.841097+0000","last_peered":"2024-04-15T23:32:22.841097+0000","last_clean":"2024-04-15T23:32:07.786600+0000","last_became_active":"2024-04-15T23:32:11.548343+0000","last_became_peered":"2024-04-15T23:32:11.548343+0000","last_unstale":"2024-04-15T23:32:22.841097+0000","last_undegraded":"2024-04-15T23:32:22.841097+0000","last_fullsized":"2024-04-15T23:32:11.544334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:17:01.902464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841675+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:32:22.841675+0000","last_peered":"2024-04-15T23:32:22.841675+0000","last_clean":"2024-04-15T23:32:22.841675+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:32:22.841675+0000","last_undegraded":"2024-04-15T23:32:22.841675+0000","last_fullsized":"2024-04-15T23:32:22.841675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387661+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:32:23.387661+0000","last_peered":"2024-04-15T23:32:23.387661+0000","last_clean":"2024-04-15T23:32:23.387661+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:32:23.387661+0000","last_undegraded":"2024-04-15T23:32:23.387661+0000","last_fullsized":"2024-04-15T23:32:23.387661+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841624+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:32:22.841624+0000","last_peered":"2024-04-15T23:32:22.841624+0000","last_clean":"2024-04-15T23:32:22.841624+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:32:22.841624+0000","last_undegraded":"2024-04-15T23:32:22.841624+0000","last_fullsized":"2024-04-15T23:32:22.841624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387487+0000","last_change":"2024-04-15T23:32:11.542193+0000","last_active":"2024-04-15T23:32:23.387487+0000","last_peered":"2024-04-15T23:32:23.387487+0000","last_clean":"2024-04-15T23:32:07.533690+0000","last_became_active":"2024-04-15T23:32:11.542193+0000","last_became_peered":"2024-04-15T23:32:11.542193+0000","last_unstale":"2024-04-15T23:32:23.387487+0000","last_undegraded":"2024-04-15T23:32:23.387487+0000","last_fullsized":"2024-04-15T23:32:11.539806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:17:23.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388052+0000","last_change":"2024-04-15T23:32:11.543916+0000","last_active":"2024-04-15T23:32:23.388052+0000","last_peered":"2024-04-15T23:32:23.388052+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543916+0000","last_became_peered":"2024-04-15T23:32:11.543916+0000","last_unstale":"2024-04-15T23:32:23.388052+0000","last_undegraded":"2024-04-15T23:32:23.388052+0000","last_fullsized":"2024-04-15T23:32:11.540434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:24:53.954892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841119+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:32:22.841119+0000","last_peered":"2024-04-15T23:32:22.841119+0000","last_clean":"2024-04-15T23:32:22.841119+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:32:22.841119+0000","last_undegraded":"2024-04-15T23:32:22.841119+0000","last_fullsized":"2024-04-15T23:32:22.841119+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841830+0000","last_change":"2024-04-15T23:32:11.548922+0000","last_active":"2024-04-15T23:32:22.841830+0000","last_peered":"2024-04-15T23:32:22.841830+0000","last_clean":"2024-04-15T23:32:07.786775+0000","last_became_active":"2024-04-15T23:32:11.548922+0000","last_became_peered":"2024-04-15T23:32:11.548922+0000","last_unstale":"2024-04-15T23:32:22.841830+0000","last_undegraded":"2024-04-15T23:32:22.841830+0000","last_fullsized":"2024-04-15T23:32:11.544390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:42:25.823499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387506+0000","last_change":"2024-04-15T23:32:11.542325+0000","last_active":"2024-04-15T23:32:23.387506+0000","last_peered":"2024-04-15T23:32:23.387506+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.542325+0000","last_became_peered":"2024-04-15T23:32:11.542325+0000","last_unstale":"2024-04-15T23:32:23.387506+0000","last_undegraded":"2024-04-15T23:32:23.387506+0000","last_fullsized":"2024-04-15T23:32:11.539842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:52:49.431439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841710+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:32:22.841710+0000","last_peered":"2024-04-15T23:32:22.841710+0000","last_clean":"2024-04-15T23:32:22.841710+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:32:22.841710+0000","last_undegraded":"2024-04-15T23:32:22.841710+0000","last_fullsized":"2024-04-15T23:32:22.841710+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.840957+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:32:22.840957+0000","last_peered":"2024-04-15T23:32:22.840957+0000","last_clean":"2024-04-15T23:32:22.840957+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:32:22.840957+0000","last_undegraded":"2024-04-15T23:32:22.840957+0000","last_fullsized":"2024-04-15T23:32:22.840957+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840413+0000","last_change":"2024-04-15T23:32:11.545347+0000","last_active":"2024-04-15T23:32:22.840413+0000","last_peered":"2024-04-15T23:32:22.840413+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545347+0000","last_became_peered":"2024-04-15T23:32:11.545347+0000","last_unstale":"2024-04-15T23:32:22.840413+0000","last_undegraded":"2024-04-15T23:32:22.840413+0000","last_fullsized":"2024-04-15T23:32:11.542681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:44:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388427+0000","last_change":"2024-04-15T23:32:11.543852+0000","last_active":"2024-04-15T23:32:23.388427+0000","last_peered":"2024-04-15T23:32:23.388427+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:32:11.543852+0000","last_became_peered":"2024-04-15T23:32:11.543852+0000","last_unstale":"2024-04-15T23:32:23.388427+0000","last_undegraded":"2024-04-15T23:32:23.388427+0000","last_fullsized":"2024-04-15T23:32:11.541322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:17.236231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387940+0000","last_change":"2024-04-15T23:32:11.542965+0000","last_active":"2024-04-15T23:32:23.387940+0000","last_peered":"2024-04-15T23:32:23.387940+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.542965+0000","last_became_peered":"2024-04-15T23:32:11.542965+0000","last_unstale":"2024-04-15T23:32:23.387940+0000","last_undegraded":"2024-04-15T23:32:23.387940+0000","last_fullsized":"2024-04-15T23:32:11.540072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:57:39.420721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387527+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:32:23.387527+0000","last_peered":"2024-04-15T23:32:23.387527+0000","last_clean":"2024-04-15T23:32:23.387527+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:32:23.387527+0000","last_undegraded":"2024-04-15T23:32:23.387527+0000","last_fullsized":"2024-04-15T23:32:23.387527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387980+0000","last_change":"2024-04-15T23:32:11.543464+0000","last_active":"2024-04-15T23:32:23.387980+0000","last_peered":"2024-04-15T23:32:23.387980+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543464+0000","last_became_peered":"2024-04-15T23:32:11.543464+0000","last_unstale":"2024-04-15T23:32:23.387980+0000","last_undegraded":"2024-04-15T23:32:23.387980+0000","last_fullsized":"2024-04-15T23:32:11.540108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:53:35.957069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841345+0000","last_change":"2024-04-15T23:32:11.548935+0000","last_active":"2024-04-15T23:32:22.841345+0000","last_peered":"2024-04-15T23:32:22.841345+0000","last_clean":"2024-04-15T23:32:07.786618+0000","last_became_active":"2024-04-15T23:32:11.548935+0000","last_became_peered":"2024-04-15T23:32:11.548935+0000","last_unstale":"2024-04-15T23:32:22.841345+0000","last_undegraded":"2024-04-15T23:32:22.841345+0000","last_fullsized":"2024-04-15T23:32:11.544475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:10:22.696167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841649+0000","last_change":"2024-04-15T23:32:11.548361+0000","last_active":"2024-04-15T23:32:22.841649+0000","last_peered":"2024-04-15T23:32:22.841649+0000","last_clean":"2024-04-15T23:32:07.786748+0000","last_became_active":"2024-04-15T23:32:11.548361+0000","last_became_peered":"2024-04-15T23:32:11.548361+0000","last_unstale":"2024-04-15T23:32:22.841649+0000","last_undegraded":"2024-04-15T23:32:22.841649+0000","last_fullsized":"2024-04-15T23:32:11.544250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:14:20.393048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387815+0000","last_change":"2024-04-15T23:32:11.542992+0000","last_active":"2024-04-15T23:32:23.387815+0000","last_peered":"2024-04-15T23:32:23.387815+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542992+0000","last_became_peered":"2024-04-15T23:32:11.542992+0000","last_unstale":"2024-04-15T23:32:23.387815+0000","last_undegraded":"2024-04-15T23:32:23.387815+0000","last_fullsized":"2024-04-15T23:32:11.540105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:11.877760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841938+0000","last_change":"2024-04-15T23:32:11.546308+0000","last_active":"2024-04-15T23:32:22.841938+0000","last_peered":"2024-04-15T23:32:22.841938+0000","last_clean":"2024-04-15T23:32:07.786926+0000","last_became_active":"2024-04-15T23:32:11.546308+0000","last_became_peered":"2024-04-15T23:32:11.546308+0000","last_unstale":"2024-04-15T23:32:22.841938+0000","last_undegraded":"2024-04-15T23:32:22.841938+0000","last_fullsized":"2024-04-15T23:32:11.543424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:54.358011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388611+0000","last_change":"2024-04-15T23:32:11.544222+0000","last_active":"2024-04-15T23:32:23.388611+0000","last_peered":"2024-04-15T23:32:23.388611+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.544222+0000","last_became_peered":"2024-04-15T23:32:11.544222+0000","last_unstale":"2024-04-15T23:32:23.388611+0000","last_undegraded":"2024-04-15T23:32:23.388611+0000","last_fullsized":"2024-04-15T23:32:11.540903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:36.399440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387730+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:32:23.387730+0000","last_peered":"2024-04-15T23:32:23.387730+0000","last_clean":"2024-04-15T23:32:23.387730+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:32:23.387730+0000","last_undegraded":"2024-04-15T23:32:23.387730+0000","last_fullsized":"2024-04-15T23:32:23.387730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387634+0000","last_change":"2024-04-15T23:32:11.543668+0000","last_active":"2024-04-15T23:32:23.387634+0000","last_peered":"2024-04-15T23:32:23.387634+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.543668+0000","last_became_peered":"2024-04-15T23:32:11.543668+0000","last_unstale":"2024-04-15T23:32:23.387634+0000","last_undegraded":"2024-04-15T23:32:23.387634+0000","last_fullsized":"2024-04-15T23:32:11.540356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:33.896469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388494+0000","last_change":"2024-04-15T23:32:11.546268+0000","last_active":"2024-04-15T23:32:23.388494+0000","last_peered":"2024-04-15T23:32:23.388494+0000","last_clean":"2024-04-15T23:32:07.534420+0000","last_became_active":"2024-04-15T23:32:11.546268+0000","last_became_peered":"2024-04-15T23:32:11.546268+0000","last_unstale":"2024-04-15T23:32:23.388494+0000","last_undegraded":"2024-04-15T23:32:23.388494+0000","last_fullsized":"2024-04-15T23:32:11.542494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:13.964566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387799+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:32:23.387799+0000","last_peered":"2024-04-15T23:32:23.387799+0000","last_clean":"2024-04-15T23:32:23.387799+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:32:23.387799+0000","last_undegraded":"2024-04-15T23:32:23.387799+0000","last_fullsized":"2024-04-15T23:32:23.387799+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":26,"reported_epoch":29,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:23.388746+0000","last_change":"2024-04-15T23:32:11.546222+0000","last_active":"2024-04-15T23:32:23.388746+0000","last_peered":"2024-04-15T23:32:23.388746+0000","last_clean":"2024-04-15T23:31:30.875670+0000","last_became_active":"2024-04-15T23:32:11.546222+0000","last_became_peered":"2024-04-15T23:32:11.546222+0000","last_unstale":"2024-04-15T23:32:23.388746+0000","last_undegraded":"2024-04-15T23:32:11.541817+0000","last_fullsized":"2024-04-15T23:32:11.540942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:24:19.706517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388875+0000","last_change":"2024-04-15T23:32:11.546473+0000","last_active":"2024-04-15T23:32:23.388875+0000","last_peered":"2024-04-15T23:32:23.388875+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.546473+0000","last_became_peered":"2024-04-15T23:32:11.546473+0000","last_unstale":"2024-04-15T23:32:23.388875+0000","last_undegraded":"2024-04-15T23:32:23.388875+0000","last_fullsized":"2024-04-15T23:32:11.541882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:07.371350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840160+0000","last_change":"2024-04-15T23:32:11.544726+0000","last_active":"2024-04-15T23:32:22.840160+0000","last_peered":"2024-04-15T23:32:22.840160+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544726+0000","last_became_peered":"2024-04-15T23:32:11.544726+0000","last_unstale":"2024-04-15T23:32:22.840160+0000","last_undegraded":"2024-04-15T23:32:22.840160+0000","last_fullsized":"2024-04-15T23:32:11.542306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:11.877760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'3","reported_seq":37,"reported_epoch":29,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:22.840933+0000","last_change":"2024-04-15T23:32:11.547480+0000","last_active":"2024-04-15T23:32:22.840933+0000","last_peered":"2024-04-15T23:32:22.840933+0000","last_clean":"2024-04-15T23:31:56.677189+0000","last_became_active":"2024-04-15T23:32:11.547480+0000","last_became_peered":"2024-04-15T23:32:11.547480+0000","last_unstale":"2024-04-15T23:32:22.840933+0000","last_undegraded":"2024-04-15T23:32:11.543622+0000","last_fullsized":"2024-04-15T23:32:11.543547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:11.644081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841957+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:32:22.841957+0000","last_peered":"2024-04-15T23:32:22.841957+0000","last_clean":"2024-04-15T23:32:22.841957+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:32:22.841957+0000","last_undegraded":"2024-04-15T23:32:22.841957+0000","last_fullsized":"2024-04-15T23:32:22.841957+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387594+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:32:23.387594+0000","last_peered":"2024-04-15T23:32:23.387594+0000","last_clean":"2024-04-15T23:32:23.387594+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:32:23.387594+0000","last_undegraded":"2024-04-15T23:32:23.387594+0000","last_fullsized":"2024-04-15T23:32:23.387594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.840808+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:32:22.840808+0000","last_peered":"2024-04-15T23:32:22.840808+0000","last_clean":"2024-04-15T23:32:22.840808+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:32:22.840808+0000","last_undegraded":"2024-04-15T23:32:22.840808+0000","last_fullsized":"2024-04-15T23:32:22.840808+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'10","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:22.841432+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:32:22.841432+0000","last_peered":"2024-04-15T23:32:22.841432+0000","last_clean":"2024-04-15T23:32:22.841432+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:32:22.841432+0000","last_undegraded":"2024-04-15T23:32:22.841432+0000","last_fullsized":"2024-04-15T23:32:22.841432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387414+0000","last_change":"2024-04-15T23:32:11.542068+0000","last_active":"2024-04-15T23:32:23.387414+0000","last_peered":"2024-04-15T23:32:23.387414+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542068+0000","last_became_peered":"2024-04-15T23:32:11.542068+0000","last_unstale":"2024-04-15T23:32:23.387414+0000","last_undegraded":"2024-04-15T23:32:23.387414+0000","last_fullsized":"2024-04-15T23:32:11.539597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:16:50.754369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388403+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:32:23.388403+0000","last_peered":"2024-04-15T23:32:23.388403+0000","last_clean":"2024-04-15T23:32:23.388403+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:32:23.388403+0000","last_undegraded":"2024-04-15T23:32:23.388403+0000","last_fullsized":"2024-04-15T23:32:23.388403+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841722+0000","last_change":"2024-04-15T23:32:11.548236+0000","last_active":"2024-04-15T23:32:22.841722+0000","last_peered":"2024-04-15T23:32:22.841722+0000","last_clean":"2024-04-15T23:32:07.787053+0000","last_became_active":"2024-04-15T23:32:11.548236+0000","last_became_peered":"2024-04-15T23:32:11.548236+0000","last_unstale":"2024-04-15T23:32:22.841722+0000","last_undegraded":"2024-04-15T23:32:22.841722+0000","last_fullsized":"2024-04-15T23:32:11.544657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:01.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840210+0000","last_change":"2024-04-15T23:32:11.544436+0000","last_active":"2024-04-15T23:32:22.840210+0000","last_peered":"2024-04-15T23:32:22.840210+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544436+0000","last_became_peered":"2024-04-15T23:32:11.544436+0000","last_unstale":"2024-04-15T23:32:22.840210+0000","last_undegraded":"2024-04-15T23:32:22.840210+0000","last_fullsized":"2024-04-15T23:32:11.542388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:52:50.436669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841125+0000","last_change":"2024-04-15T23:32:11.546257+0000","last_active":"2024-04-15T23:32:22.841125+0000","last_peered":"2024-04-15T23:32:22.841125+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.546257+0000","last_became_peered":"2024-04-15T23:32:11.546257+0000","last_unstale":"2024-04-15T23:32:22.841125+0000","last_undegraded":"2024-04-15T23:32:22.841125+0000","last_fullsized":"2024-04-15T23:32:11.543657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:17.519004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387253+0000","last_change":"2024-04-15T23:32:11.540897+0000","last_active":"2024-04-15T23:32:23.387253+0000","last_peered":"2024-04-15T23:32:23.387253+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.540897+0000","last_became_peered":"2024-04-15T23:32:11.540897+0000","last_unstale":"2024-04-15T23:32:23.387253+0000","last_undegraded":"2024-04-15T23:32:23.387253+0000","last_fullsized":"2024-04-15T23:32:11.539469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:39:20.518476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388959+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:32:23.388959+0000","last_peered":"2024-04-15T23:32:23.388959+0000","last_clean":"2024-04-15T23:32:23.388959+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:32:23.388959+0000","last_undegraded":"2024-04-15T23:32:23.388959+0000","last_fullsized":"2024-04-15T23:32:23.388959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387711+0000","last_change":"2024-04-15T23:32:11.543133+0000","last_active":"2024-04-15T23:32:23.387711+0000","last_peered":"2024-04-15T23:32:23.387711+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.543133+0000","last_became_peered":"2024-04-15T23:32:11.543133+0000","last_unstale":"2024-04-15T23:32:23.387711+0000","last_undegraded":"2024-04-15T23:32:23.387711+0000","last_fullsized":"2024-04-15T23:32:11.540630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:00.931096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.841025+0000","last_change":"2024-04-15T23:32:11.547180+0000","last_active":"2024-04-15T23:32:22.841025+0000","last_peered":"2024-04-15T23:32:22.841025+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:32:22.841025+0000","last_undegraded":"2024-04-15T23:32:22.841025+0000","last_fullsized":"2024-04-15T23:32:11.544284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:24:20.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840516+0000","last_change":"2024-04-15T23:32:11.545332+0000","last_active":"2024-04-15T23:32:22.840516+0000","last_peered":"2024-04-15T23:32:22.840516+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545332+0000","last_became_peered":"2024-04-15T23:32:11.545332+0000","last_unstale":"2024-04-15T23:32:22.840516+0000","last_undegraded":"2024-04-15T23:32:22.840516+0000","last_fullsized":"2024-04-15T23:32:11.542751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:17:29.563001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.387899+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:32:23.387899+0000","last_peered":"2024-04-15T23:32:23.387899+0000","last_clean":"2024-04-15T23:32:23.387899+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:32:23.387899+0000","last_undegraded":"2024-04-15T23:32:23.387899+0000","last_fullsized":"2024-04-15T23:32:23.387899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":45,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387982+0000","last_change":"2024-04-15T23:32:11.543424+0000","last_active":"2024-04-15T23:32:23.387982+0000","last_peered":"2024-04-15T23:32:23.387982+0000","last_clean":"2024-04-15T23:32:07.533959+0000","last_became_active":"2024-04-15T23:32:11.543424+0000","last_became_peered":"2024-04-15T23:32:11.543424+0000","last_unstale":"2024-04-15T23:32:23.387982+0000","last_undegraded":"2024-04-15T23:32:23.387982+0000","last_fullsized":"2024-04-15T23:32:11.540315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:44:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388140+0000","last_change":"2024-04-15T23:32:11.543802+0000","last_active":"2024-04-15T23:32:23.388140+0000","last_peered":"2024-04-15T23:32:23.388140+0000","last_clean":"2024-04-15T23:32:07.533902+0000","last_became_active":"2024-04-15T23:32:11.543802+0000","last_became_peered":"2024-04-15T23:32:11.543802+0000","last_unstale":"2024-04-15T23:32:23.388140+0000","last_undegraded":"2024-04-15T23:32:23.388140+0000","last_fullsized":"2024-04-15T23:32:11.540623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:04.145901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388259+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:32:23.388259+0000","last_peered":"2024-04-15T23:32:23.388259+0000","last_clean":"2024-04-15T23:32:23.388259+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:32:23.388259+0000","last_undegraded":"2024-04-15T23:32:23.388259+0000","last_fullsized":"2024-04-15T23:32:23.388259+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840581+0000","last_change":"2024-04-15T23:32:11.545464+0000","last_active":"2024-04-15T23:32:22.840581+0000","last_peered":"2024-04-15T23:32:22.840581+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:32:11.545464+0000","last_became_peered":"2024-04-15T23:32:11.545464+0000","last_unstale":"2024-04-15T23:32:22.840581+0000","last_undegraded":"2024-04-15T23:32:22.840581+0000","last_fullsized":"2024-04-15T23:32:11.542953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":46,"reported_epoch":29,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:22.841117+0000","last_change":"2024-04-15T23:32:11.547001+0000","last_active":"2024-04-15T23:32:22.841117+0000","last_peered":"2024-04-15T23:32:22.841117+0000","last_clean":"2024-04-15T23:32:07.786711+0000","last_became_active":"2024-04-15T23:32:11.547001+0000","last_became_peered":"2024-04-15T23:32:11.547001+0000","last_unstale":"2024-04-15T23:32:22.841117+0000","last_undegraded":"2024-04-15T23:32:11.543553+0000","last_fullsized":"2024-04-15T23:32:11.543469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:04:01.920070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840875+0000","last_change":"2024-04-15T23:32:11.547235+0000","last_active":"2024-04-15T23:32:22.840875+0000","last_peered":"2024-04-15T23:32:22.840875+0000","last_clean":"2024-04-15T23:32:07.786529+0000","last_became_active":"2024-04-15T23:32:11.547235+0000","last_became_peered":"2024-04-15T23:32:11.547235+0000","last_unstale":"2024-04-15T23:32:22.840875+0000","last_undegraded":"2024-04-15T23:32:22.840875+0000","last_fullsized":"2024-04-15T23:32:11.544228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:51:42.570150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-15T23:32:23.388277+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:32:23.388277+0000","last_peered":"2024-04-15T23:32:23.388277+0000","last_clean":"2024-04-15T23:32:23.388277+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:32:23.388277+0000","last_undegraded":"2024-04-15T23:32:23.388277+0000","last_fullsized":"2024-04-15T23:32:23.388277+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.387693+0000","last_change":"2024-04-15T23:32:11.543217+0000","last_active":"2024-04-15T23:32:23.387693+0000","last_peered":"2024-04-15T23:32:23.387693+0000","last_clean":"2024-04-15T23:32:07.533827+0000","last_became_active":"2024-04-15T23:32:11.543217+0000","last_became_peered":"2024-04-15T23:32:11.543217+0000","last_unstale":"2024-04-15T23:32:23.387693+0000","last_undegraded":"2024-04-15T23:32:23.387693+0000","last_fullsized":"2024-04-15T23:32:11.539906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:27:36.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":16,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:23.388500+0000","last_change":"2024-04-15T23:32:11.545980+0000","last_active":"2024-04-15T23:32:23.388500+0000","last_peered":"2024-04-15T23:32:23.388500+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545980+0000","last_became_peered":"2024-04-15T23:32:11.545980+0000","last_unstale":"2024-04-15T23:32:23.388500+0000","last_undegraded":"2024-04-15T23:32:23.388500+0000","last_fullsized":"2024-04-15T23:32:11.541496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:04:01.920070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+undersized","last_fresh":"2024-04-15T23:32:22.840780+0000","last_change":"2024-04-15T23:32:11.548138+0000","last_active":"2024-04-15T23:32:22.840780+0000","last_peered":"2024-04-15T23:32:22.840780+0000","last_clean":"2024-04-15T23:32:07.786282+0000","last_became_active":"2024-04-15T23:32:11.548138+0000","last_became_peered":"2024-04-15T23:32:11.548138+0000","last_unstale":"2024-04-15T23:32:22.840780+0000","last_undegraded":"2024-04-15T23:32:22.840780+0000","last_fullsized":"2024-04-15T23:32:11.544570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:06.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":26,"reported_epoch":29,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:22.841772+0000","last_change":"2024-04-15T23:32:11.547071+0000","last_active":"2024-04-15T23:32:22.841772+0000","last_peered":"2024-04-15T23:32:22.841772+0000","last_clean":"2024-04-15T23:31:30.875139+0000","last_became_active":"2024-04-15T23:32:11.547071+0000","last_became_peered":"2024-04-15T23:32:11.547071+0000","last_unstale":"2024-04-15T23:32:22.841772+0000","last_undegraded":"2024-04-15T23:32:11.544177+0000","last_fullsized":"2024-04-15T23:32:11.543927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:26.821850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":43,"acting":43,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":204800,"data_stored":80548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738384,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":704662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738382,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":704046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:32:26.298 INFO:tasks.thrashosds.thrasher:Setting 4.2f to [1, 2, 0] 2024-04-15T23:32:26.298 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.2f', '1', '2', '0'] 2024-04-15T23:32:26.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.2f 1 2 0 2024-04-15T23:32:26.353 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:26.353 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:26.353 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:26.353 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:26.353 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:26.362 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:26.373 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:26.390+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:26.474 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:26.491+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.512 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.456829677999998, 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:26.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:26.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:26.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:26.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.456137134000002, 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:26.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.524 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.455745219999997, 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:26.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:26.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.529 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.455410774999997, 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.530 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:26.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.454115422000001, 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:26.535 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:26.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.101849559000001, 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:26.540 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:26.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.101626557000003, 2024-04-15T23:32:26.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:26.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:26.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.101185714000003, 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:26.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:26.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.100533757000001, 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:26.556 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:26.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:26.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.099727489999999, 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:26.562 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:26.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.097626996000002, 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:26.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:26.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:26.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.572 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.660162917999997, 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.579 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.660106173999999, 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:26.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:26.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659995018000004, 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:26.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:26.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:26.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:26.592 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659908004000002, 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:26.598 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659874303000002, 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:26.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659685764000002, 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:26.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659641546000003, 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:26.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:26.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659601047000002, 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:26.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.659559336999997, 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:26.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:26.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:26.628 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:26.630 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:26.631 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:26.647+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.649 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-15T23:32:26.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-15T23:32:26.655 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-15T23:32:26.730 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:26.747+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:26.742 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:26.742 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:26.742 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:26.743 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:26.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:26.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-04-15T23:32:26.831 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:26.848+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:26.859 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:26.859 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:26.859 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:26.859 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:26.859 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:26.868 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:26.952 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:26.969+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:27.018 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.964743474999999, 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.019 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:27.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:27.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.964661986999999, 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.025 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:27.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166570296000003, 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:27.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:27.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166522305999997, 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.037 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:27.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166484007000001, 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:27.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:27.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:27.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166445219000003, 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:27.048 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.053 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166421888000002, 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.058 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166391402999999, 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:27.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:27.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:27.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:27.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166356334, 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:27.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:27.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166332591, 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:27.069 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.074 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166308332, 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:27.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:27.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:27.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:27.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:27.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.079 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166279993000003, 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166241194000001, 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.086 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:27.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:27.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:27.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:27.091 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166206023000001, 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:27.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:27.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:27.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.096 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166172654999997, 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.166115194, 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:27.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.164479534000002, 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.107 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:27.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:27.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.163588001999997, 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.112 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.117 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.163536653999998, 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.122 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 56.163498537999999, 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:27.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:27.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:27.127 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:27.128 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:27.129 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:27.145+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:27.229 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:27.245+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:27.244 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:27.244 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:27.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:27.330 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:27.347+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:27.403 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:27.403 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:27.403 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:27.403 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:27.403 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:27.411 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:27.431 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:27.447+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:27.521 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:27.521 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.465881817000003, 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.465189273, 2024-04-15T23:32:27.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:27.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:27.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.464797359000002, 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:27.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:27.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.464462914000002, 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:27.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:27.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.543 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.463167560999999, 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:27.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:27.549 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.110901697999999, 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:27.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.110678696000001, 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:27.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.110237853000001, 2024-04-15T23:32:27.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:27.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.109585895999999, 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:27.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:27.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.108779628999997, 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:27.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.106679135, 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:27.576 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:27.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.581 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.669215057000002, 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:27.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:27.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:27.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:27.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.669158312999997, 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.588 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:27.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.669047157000001, 2024-04-15T23:32:27.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:27.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:27.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:27.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.668960143, 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:27.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:27.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:27.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:27.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:27.607 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.668926442, 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:27.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:27.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.668737903, 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.614 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:27.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.668693685000001, 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:27.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:27.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:27.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:27.627 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.668653186, 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:27.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:27.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.668611476000002, 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:27.632 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:27.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:27.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:27.637 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:27.637 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:27.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:27.639 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:27.655+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:27.739 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:27.756+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:27.754 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:27.754 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:27.754 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:27.754 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:27.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:27.840 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:27.857+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:27.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:32:27.871 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:27.871 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:27.871 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:27.871 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:27.871 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:27.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:27.963 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:27.980+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.975907769000003, 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.030 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:28.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:28.035 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 61.975826281000003, 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:28.036 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:28.041 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.17773459, 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:28.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.046 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177686600000001, 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:28.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:28.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:28.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:28.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:28.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177648300999998, 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.056 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177609513, 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.057 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:28.058 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:28.059 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:28.060 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:28.061 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177586181999999, 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:28.062 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.063 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:28.064 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.065 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:28.066 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:28.067 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177555697000003, 2024-04-15T23:32:28.068 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.069 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.071 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.072 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.073 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177520628000003, 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:28.074 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:28.075 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.076 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:28.077 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.078 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177496884999996, 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.079 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.080 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.081 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.082 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.083 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.084 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177472625999997, 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.085 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.089 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177444287, 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:28.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:28.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:28.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177405487999998, 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.095 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:28.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:28.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:28.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:28.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:28.101 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177370316999998, 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:28.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177336949000001, 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:28.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:28.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:28.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.177279488000003, 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:28.112 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:28.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:28.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.117 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.175643827999998, 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:28.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:28.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:28.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:28.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.174752296000001, 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.174700948000002, 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:28.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:28.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:28.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 57.174662832000003, 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:28.133 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:28.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:28.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:28.137 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:28.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:28.139 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:28.155+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:28.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:28.240 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:28.257+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:28.252 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:28.252 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:28.252 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:28.252 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:28.261 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:28.267 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:28.267 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:28.288 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:28.288 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:28.288 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:28.291 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:28.291 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:28.341 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:28.357+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:28.369 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:28.369 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:28.378 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:28.442 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:28.459+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:28.526 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:28.526 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:28.535 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:28.579 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:28.596+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:28.644 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:28.661+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:28.646 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:28.646 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:28.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:28.745 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:28.762+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:28.803 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:28.803 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:28.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:28.829 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:32:28.857 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:28.874+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:28.921 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:28.921 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:28.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:28.973 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:28.990+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:29.039 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.039 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.046 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:29.064+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:29.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:29.147 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:29.164+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:29.198 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.198 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:29.249 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:29.265+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:29.349 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:29.366+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:29.356 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.356 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.365 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:29.450 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:29.467+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:29.475 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.476 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:29.551 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:29.568+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:29.592 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.592 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:29.684 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:29.701+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:29.748 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.749 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.753 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:29.770+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:29.757 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:29.853 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:29.870+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:29.867 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:29.868 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:29.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:29.960 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:29.977+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:30.025 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:30.025 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:30.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:30.055 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:30.072+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:30.158 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:30.175+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:30.182 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:30.182 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:30.191 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:30.259 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:30.276+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:30.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:30.300 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:30.300 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:30.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:30.360 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:30.376+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:30.417 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:30.417 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:30.420 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:30.420 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:30.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:30.439 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:30.440 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:30.440 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:30.443 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:30.443 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:30.469 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:30.486+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:30.536 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:30.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.481338418000007, 2024-04-15T23:32:30.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:30.538 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:30.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:30.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:30.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:30.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:30.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:30.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:30.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:30.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:30.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:30.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:30.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:30.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:30.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:30.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:30.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:30.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:30.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:30.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:30.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:30.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:30.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:30.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.550 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.550 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.551 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:30.551 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:30.551 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.481256930000001, 2024-04-15T23:32:30.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:30.552 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:30.553 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:30.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.553 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:30.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:30.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:30.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:30.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:30.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:30.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:30.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:30.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:30.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:30.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:30.564 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.683165238999997, 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.569 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.683117248999999, 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:30.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:30.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:30.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:30.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.683078950000002, 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.683040161999998, 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.580 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:30.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:30.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.683016831000003, 2024-04-15T23:32:30.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.590 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682986346, 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:30.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682951277000001, 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:30.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:30.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682927534000001, 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682903275000001, 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.606 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:30.611 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682874935999997, 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:30.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:30.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:30.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682836137000002, 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:30.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:30.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:30.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682800966000002, 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:30.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682767597999998, 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.682710137000001, 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:30.638 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.681074477000003, 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:30.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:30.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:30.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.643 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.680182944999999, 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.680131596999999, 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:30.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:30.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.653 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 59.680093481, 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:30.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:30.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:30.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:30.657 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:30.659 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:30.676+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:30.659 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:30.760 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:30.777+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:30.769 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:30.769 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:30.769 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:30.769 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:30.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:30.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:32:30.861 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:30.877+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:30.886 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:30.886 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:30.887 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:30.887 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:30.887 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:30.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:30.962 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:30.979+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.990360185, 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:31.046 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:31.050 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.989667640999997, 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:31.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:31.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:31.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:31.055 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:31.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.989275727000006, 2024-04-15T23:32:31.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:31.059 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.988941281999999, 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:31.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:31.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:31.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.987645928999996, 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:31.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.635380065999996, 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.635157063999998, 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:31.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:31.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:31.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.634716221000005, 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.634064264000003, 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.633257997000001, 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:31.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:31.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:31.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.631157502999997, 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:31.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193693424999999, 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193636681000001, 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193525524999998, 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:31.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:31.109 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193438510999997, 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:31.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:31.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:31.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193404809999997, 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:31.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193216270999997, 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.120 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:31.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:31.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:31.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:31.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193172052999998, 2024-04-15T23:32:31.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:31.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:31.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:31.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.130 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193131553999997, 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:31.134 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.193089843999999, 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:31.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:31.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:31.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:31.138 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:31.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:31.140 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:31.156+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.240 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:31.257+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.251 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:31.251 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:31.251 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:31.251 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:31.260 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:31.344 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:31.361+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.409 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:31.409 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:31.409 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:31.417 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:31.458 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:31.475+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.544 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:31.561+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.514293041000002, 2024-04-15T23:32:31.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:31.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:31.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:31.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:31.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.514211552999996, 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:31.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:31.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:31.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.716119861999999, 2024-04-15T23:32:31.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:31.586 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.587 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.716071872000001, 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.716033572999997, 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.595 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715994784999999, 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.600 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715971453999998, 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.605 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:31.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:31.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:31.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715940969000002, 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.610 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:31.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:31.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:31.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715905900000003, 2024-04-15T23:32:31.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:31.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715882157000003, 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:31.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.625 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715857898000003, 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:31.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:31.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:31.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715829558999999, 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:31.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.635 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715790759999997, 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:31.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715755588999997, 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715722221, 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.646 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.715664760000003, 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.651 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:31.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:31.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:31.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:31.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.714029099999998, 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.656 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:31.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:31.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.713137568, 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.661 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:31.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:31.666 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.713086220000001, 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:31.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.671 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 60.713048104000002, 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:31.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:31.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:31.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:31.676 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:31.676 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:31.676 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-15T23:32:31.676 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-15T23:32:31.677 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:31.694+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:31.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:31.777 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:31.794+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:31.795 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:31.795 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:31.795 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:31.795 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:31.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:31.841 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:32:31.878 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:31.894+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:31.913 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:31.913 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:31.913 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:31.913 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:31.913 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:31.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 32, 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-04-15T23:31:15.484738+0000", 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-04-15T23:32:31.851012+0000", 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-04-15T23:32:10.524116+0000", 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-04-15T23:31:16.326489+0000", 2024-04-15T23:32:31.989 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5804032, 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "nodeep-scrub", 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 4, 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-15T23:32:31.990 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 4, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 3, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.797113+0000", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:31.991 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-04-15T23:32:31.992 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:31.993 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:31.994 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:31.995 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:31.997 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-04-15T23:32:31.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:31.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.948719+0000", 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:32.000 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.001 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:32.002 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:32.003 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:32.004 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.4900000095367432, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.4900000095367432, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_metadata", 2024-04-15T23:32:32.005 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:28.382708+0000", 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-04-15T23:32:32.006 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "14", 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:32.007 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:32.008 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.009 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_bias": 4, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 16, 2024-04-15T23:32:32.010 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_priority": 5 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": "cephfs" 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.690000057220459, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.690000057220459, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:32.011 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 4, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_data", 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:29.186157+0000", 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:32.012 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 64, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 64, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 64, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 64, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 64, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:32.013 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "15", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:32.014 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:32.015 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:32.016 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 64, 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "target_size_ratio": 0.89999997615814209 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "data": "cephfs" 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:32.017 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.5800000429153442, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.5800000429153442, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.059999942779541, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.059999942779541, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "37ee61ed-86ab-4308-a161-cd2aafcfd4f9", 2024-04-15T23:32:32.018 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.019 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6800", 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6801", 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6802", 2024-04-15T23:32:32.020 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6803", 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6806", 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6807", 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6804", 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.022 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6805", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.107:6801/1269237815", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.107:6803/1269237815", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.107:6807/1269237815", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.107:6805/1269237815", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:32.023 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "9631dded-d96a-40ad-945d-252291b498da", 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:32.024 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6800", 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6801", 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6802", 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6803", 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.026 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6806", 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6807", 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:32.027 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6804", 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6805", 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.028 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.115:6801/1544615186", 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.115:6803/1544615186", 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.115:6807/1544615186", 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.115:6805/1544615186", 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "45415c3c-3208-4cab-b6d2-75f250746bef", 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 0, 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:32.029 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 24, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6800", 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6801", 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6802", 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6803", 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.032 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6806", 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6807", 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:32.033 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6804", 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6805", 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.034 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.195:6801/2023242123", 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.195:6803/2023242123", 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.195:6807/2023242123", 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.195:6805/2023242123", 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "exists" 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:32.035 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.385592+0000", 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.370073+0000", 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:32.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.369726+0000", 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 23 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "4.9", 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:32.037 INFO:teuthology.orchestra.run.smithi102.stdout: 0, 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: 1 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-04-15T23:32:32.038 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-04-15T23:32:32.039 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-04-15T23:32:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-04-15T23:32:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-04-15T23:32:32.040 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:32.040 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:32:32.040 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:32.023+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:32.042 INFO:tasks.thrashosds.thrasher:j is {'epoch': 32, 'fsid': '60f632e8-f087-41df-a0b6-043b99131bd6', 'created': '2024-04-15T23:31:15.484738+0000', 'modified': '2024-04-15T23:32:31.851012+0000', 'last_up_change': '2024-04-15T23:32:10.524116+0000', 'last_in_change': '2024-04-15T23:31:16.326489+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 1269237815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 1269237815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 1269237815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 1269237815}]}, 'public_addr': '172.21.15.107:6801/1269237815', 'cluster_addr': '172.21.15.107:6803/1269237815', 'heartbeat_back_addr': '172.21.15.107:6807/1269237815', 'heartbeat_front_addr': '172.21.15.107:6805/1269237815', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9631dded-d96a-40ad-945d-252291b498da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 1544615186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 1544615186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 1544615186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 1544615186}]}, 'public_addr': '172.21.15.115:6801/1544615186', 'cluster_addr': '172.21.15.115:6803/1544615186', 'heartbeat_back_addr': '172.21.15.115:6807/1544615186', 'heartbeat_front_addr': '172.21.15.115:6805/1544615186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '45415c3c-3208-4cab-b6d2-75f250746bef', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 24, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 2023242123}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 2023242123}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 2023242123}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 2023242123}]}, 'public_addr': '172.21.15.195:6801/2023242123', 'cluster_addr': '172.21.15.195:6803/2023242123', 'heartbeat_back_addr': '172.21.15.195:6807/2023242123', 'heartbeat_front_addr': '172.21.15.195:6805/2023242123', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.385592+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.370073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.369726+0000', 'dead_epoch': 23}], 'pg_upmap': [{'pgid': '4.9', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-15T23:32:32.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:32:32.072 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:32.072 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:32.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.016837628000005, 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.016145084000001, 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.015753169999996, 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:32.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:32.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.015418725000004, 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.086 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:32.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:32.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.014123372, 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.090 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:32.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:32.094 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.661857509000001, 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:32.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:32.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:32.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.661634507000002, 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.661193663999995, 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:32.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:32.107 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.660541706999993, 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.111 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.659735440000006, 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:32.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.657634946000002, 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:32.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.220170867999997, 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:32.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:32.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:32.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.220114123999998, 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.220002968000003, 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:32.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:32.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:32.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.219915954000001, 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:32.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:32.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:32.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.219882253000002, 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:32.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.219693714000002, 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:32.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.219649496000002, 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:32.153 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:32.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:32.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:32.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:32.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.219608997000002, 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:32.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:32.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:32.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.219567286999997, 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:32.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:32.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:32.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:32.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:32.288 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:32.290 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:32.290 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:32.306+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:32.391 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:32.392 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:32:32.394 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:32.411+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:32.403 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-15T23:32:31.856146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":99620,"kb_used_data":1920,"kb_used_omap":4,"kb_used_meta":97659,"kb_avail":283015900,"statfs":{"total":289910292480,"available":289808281600,"internally_reserved":0,"allocated":1966080,"data_stored":1497738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":100003151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.077815"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.584103+0000","last_change":"2024-04-15T23:32:11.544352+0000","last_active":"2024-04-15T23:32:26.584103+0000","last_peered":"2024-04-15T23:32:26.584103+0000","last_clean":"2024-04-15T23:32:07.534338+0000","last_became_active":"2024-04-15T23:32:11.544352+0000","last_became_peered":"2024-04-15T23:32:11.544352+0000","last_unstale":"2024-04-15T23:32:26.584103+0000","last_undegraded":"2024-04-15T23:32:26.584103+0000","last_fullsized":"2024-04-15T23:32:11.541160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:46:57.018356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583277+0000","last_change":"2024-04-15T23:32:11.543124+0000","last_active":"2024-04-15T23:32:26.583277+0000","last_peered":"2024-04-15T23:32:26.583277+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:32:11.543124+0000","last_became_peered":"2024-04-15T23:32:11.543124+0000","last_unstale":"2024-04-15T23:32:26.583277+0000","last_undegraded":"2024-04-15T23:32:26.583277+0000","last_fullsized":"2024-04-15T23:32:11.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:17:30.568231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847053+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:32:25.847053+0000","last_peered":"2024-04-15T23:32:25.847053+0000","last_clean":"2024-04-15T23:32:25.847053+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:32:25.847053+0000","last_undegraded":"2024-04-15T23:32:25.847053+0000","last_fullsized":"2024-04-15T23:32:25.847053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847041+0000","last_change":"2024-04-15T23:32:11.545419+0000","last_active":"2024-04-15T23:32:25.847041+0000","last_peered":"2024-04-15T23:32:25.847041+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:32:11.545419+0000","last_became_peered":"2024-04-15T23:32:11.545419+0000","last_unstale":"2024-04-15T23:32:25.847041+0000","last_undegraded":"2024-04-15T23:32:25.847041+0000","last_fullsized":"2024-04-15T23:32:11.542769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:34.901699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583047+0000","last_change":"2024-04-15T23:32:11.543474+0000","last_active":"2024-04-15T23:32:26.583047+0000","last_peered":"2024-04-15T23:32:26.583047+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:32:11.543474+0000","last_became_peered":"2024-04-15T23:32:11.543474+0000","last_unstale":"2024-04-15T23:32:26.583047+0000","last_undegraded":"2024-04-15T23:32:26.583047+0000","last_fullsized":"2024-04-15T23:32:11.540447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846444+0000","last_change":"2024-04-15T23:32:11.545668+0000","last_active":"2024-04-15T23:32:25.846444+0000","last_peered":"2024-04-15T23:32:25.846444+0000","last_clean":"2024-04-15T23:32:07.786325+0000","last_became_active":"2024-04-15T23:32:11.545668+0000","last_became_peered":"2024-04-15T23:32:11.545668+0000","last_unstale":"2024-04-15T23:32:25.846444+0000","last_undegraded":"2024-04-15T23:32:25.846444+0000","last_fullsized":"2024-04-15T23:32:11.542733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:01.936327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846730+0000","last_change":"2024-04-15T23:32:11.546347+0000","last_active":"2024-04-15T23:32:25.846730+0000","last_peered":"2024-04-15T23:32:25.846730+0000","last_clean":"2024-04-15T23:32:07.786350+0000","last_became_active":"2024-04-15T23:32:11.546347+0000","last_became_peered":"2024-04-15T23:32:11.546347+0000","last_unstale":"2024-04-15T23:32:25.846730+0000","last_undegraded":"2024-04-15T23:32:25.846730+0000","last_fullsized":"2024-04-15T23:32:11.543107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:17.236231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846303+0000","last_change":"2024-04-15T23:32:11.545203+0000","last_active":"2024-04-15T23:32:25.846303+0000","last_peered":"2024-04-15T23:32:25.846303+0000","last_clean":"2024-04-15T23:32:07.786081+0000","last_became_active":"2024-04-15T23:32:11.545203+0000","last_became_peered":"2024-04-15T23:32:11.545203+0000","last_unstale":"2024-04-15T23:32:25.846303+0000","last_undegraded":"2024-04-15T23:32:25.846303+0000","last_fullsized":"2024-04-15T23:32:11.542426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:27:36.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.584290+0000","last_change":"2024-04-15T23:32:11.545953+0000","last_active":"2024-04-15T23:32:26.584290+0000","last_peered":"2024-04-15T23:32:26.584290+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545953+0000","last_became_peered":"2024-04-15T23:32:11.545953+0000","last_unstale":"2024-04-15T23:32:26.584290+0000","last_undegraded":"2024-04-15T23:32:26.584290+0000","last_fullsized":"2024-04-15T23:32:11.541547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:55.363242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583297+0000","last_change":"2024-04-15T23:32:11.543541+0000","last_active":"2024-04-15T23:32:26.583297+0000","last_peered":"2024-04-15T23:32:26.583297+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:32:11.543541+0000","last_became_peered":"2024-04-15T23:32:11.543541+0000","last_unstale":"2024-04-15T23:32:26.583297+0000","last_undegraded":"2024-04-15T23:32:26.583297+0000","last_fullsized":"2024-04-15T23:32:11.541225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:18.524235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847071+0000","last_change":"2024-04-15T23:32:11.545422+0000","last_active":"2024-04-15T23:32:25.847071+0000","last_peered":"2024-04-15T23:32:25.847071+0000","last_clean":"2024-04-15T23:32:07.786647+0000","last_became_active":"2024-04-15T23:32:11.545422+0000","last_became_peered":"2024-04-15T23:32:11.545422+0000","last_unstale":"2024-04-15T23:32:25.847071+0000","last_undegraded":"2024-04-15T23:32:25.847071+0000","last_fullsized":"2024-04-15T23:32:11.543014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:53:35.957069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.583467+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:32:26.583467+0000","last_peered":"2024-04-15T23:32:26.583467+0000","last_clean":"2024-04-15T23:32:26.583467+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:32:26.583467+0000","last_undegraded":"2024-04-15T23:32:26.583467+0000","last_fullsized":"2024-04-15T23:32:26.583467+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582890+0000","last_change":"2024-04-15T23:32:11.543005+0000","last_active":"2024-04-15T23:32:26.582890+0000","last_peered":"2024-04-15T23:32:26.582890+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:32:11.543005+0000","last_became_peered":"2024-04-15T23:32:11.543005+0000","last_unstale":"2024-04-15T23:32:26.582890+0000","last_undegraded":"2024-04-15T23:32:26.582890+0000","last_fullsized":"2024-04-15T23:32:11.540304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:35:52.653842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.846480+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:32:25.846480+0000","last_peered":"2024-04-15T23:32:25.846480+0000","last_clean":"2024-04-15T23:32:25.846480+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:32:25.846480+0000","last_undegraded":"2024-04-15T23:32:25.846480+0000","last_fullsized":"2024-04-15T23:32:25.846480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.846770+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:32:25.846770+0000","last_peered":"2024-04-15T23:32:25.846770+0000","last_clean":"2024-04-15T23:32:25.846770+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:32:25.846770+0000","last_undegraded":"2024-04-15T23:32:25.846770+0000","last_fullsized":"2024-04-15T23:32:25.846770+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846304+0000","last_change":"2024-04-15T23:32:11.546233+0000","last_active":"2024-04-15T23:32:25.846304+0000","last_peered":"2024-04-15T23:32:25.846304+0000","last_clean":"2024-04-15T23:32:07.786096+0000","last_became_active":"2024-04-15T23:32:11.546233+0000","last_became_peered":"2024-04-15T23:32:11.546233+0000","last_unstale":"2024-04-15T23:32:25.846304+0000","last_undegraded":"2024-04-15T23:32:25.846304+0000","last_fullsized":"2024-04-15T23:32:11.542583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:41.677401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583549+0000","last_change":"2024-04-15T23:32:11.543951+0000","last_active":"2024-04-15T23:32:26.583549+0000","last_peered":"2024-04-15T23:32:26.583549+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543951+0000","last_became_peered":"2024-04-15T23:32:11.543951+0000","last_unstale":"2024-04-15T23:32:26.583549+0000","last_undegraded":"2024-04-15T23:32:26.583549+0000","last_fullsized":"2024-04-15T23:32:11.540820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:22:51.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583818+0000","last_change":"2024-04-15T23:32:11.546238+0000","last_active":"2024-04-15T23:32:26.583818+0000","last_peered":"2024-04-15T23:32:26.583818+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:32:11.546238+0000","last_became_peered":"2024-04-15T23:32:11.546238+0000","last_unstale":"2024-04-15T23:32:26.583818+0000","last_undegraded":"2024-04-15T23:32:26.583818+0000","last_fullsized":"2024-04-15T23:32:11.541553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:51:42.570150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583101+0000","last_change":"2024-04-15T23:32:11.546015+0000","last_active":"2024-04-15T23:32:26.583101+0000","last_peered":"2024-04-15T23:32:26.583101+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:32:26.583101+0000","last_undegraded":"2024-04-15T23:32:26.583101+0000","last_fullsized":"2024-04-15T23:32:11.541074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:30.047705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847229+0000","last_change":"2024-04-15T23:32:11.546261+0000","last_active":"2024-04-15T23:32:25.847229+0000","last_peered":"2024-04-15T23:32:25.847229+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:32:11.546261+0000","last_became_peered":"2024-04-15T23:32:11.546261+0000","last_unstale":"2024-04-15T23:32:25.847229+0000","last_undegraded":"2024-04-15T23:32:25.847229+0000","last_fullsized":"2024-04-15T23:32:11.542768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:24:53.954892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846955+0000","last_change":"2024-04-15T23:32:11.545687+0000","last_active":"2024-04-15T23:32:25.846955+0000","last_peered":"2024-04-15T23:32:25.846955+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:32:11.545687+0000","last_became_peered":"2024-04-15T23:32:11.545687+0000","last_unstale":"2024-04-15T23:32:25.846955+0000","last_undegraded":"2024-04-15T23:32:25.846955+0000","last_fullsized":"2024-04-15T23:32:11.543335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:35:52.653842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.583135+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:32:26.583135+0000","last_peered":"2024-04-15T23:32:26.583135+0000","last_clean":"2024-04-15T23:32:26.583135+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:32:26.583135+0000","last_undegraded":"2024-04-15T23:32:26.583135+0000","last_fullsized":"2024-04-15T23:32:26.583135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846251+0000","last_change":"2024-04-15T23:32:11.543830+0000","last_active":"2024-04-15T23:32:25.846251+0000","last_peered":"2024-04-15T23:32:25.846251+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543830+0000","last_became_peered":"2024-04-15T23:32:11.543830+0000","last_unstale":"2024-04-15T23:32:25.846251+0000","last_undegraded":"2024-04-15T23:32:25.846251+0000","last_fullsized":"2024-04-15T23:32:11.542394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:14.580653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582664+0000","last_change":"2024-04-15T23:32:11.541949+0000","last_active":"2024-04-15T23:32:26.582664+0000","last_peered":"2024-04-15T23:32:26.582664+0000","last_clean":"2024-04-15T23:32:07.533578+0000","last_became_active":"2024-04-15T23:32:11.541949+0000","last_became_peered":"2024-04-15T23:32:11.541949+0000","last_unstale":"2024-04-15T23:32:26.582664+0000","last_undegraded":"2024-04-15T23:32:26.582664+0000","last_fullsized":"2024-04-15T23:32:11.539550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:40:09.112117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.584187+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:32:26.584187+0000","last_peered":"2024-04-15T23:32:26.584187+0000","last_clean":"2024-04-15T23:32:26.584187+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:32:26.584187+0000","last_undegraded":"2024-04-15T23:32:26.584187+0000","last_fullsized":"2024-04-15T23:32:26.584187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.848354+0000","last_change":"2024-04-15T23:32:11.548257+0000","last_active":"2024-04-15T23:32:25.848354+0000","last_peered":"2024-04-15T23:32:25.848354+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:32:25.848354+0000","last_undegraded":"2024-04-15T23:32:25.848354+0000","last_fullsized":"2024-04-15T23:32:11.544630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:29:48.946199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847135+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:32:25.847135+0000","last_peered":"2024-04-15T23:32:25.847135+0000","last_clean":"2024-04-15T23:32:25.847135+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:32:25.847135+0000","last_undegraded":"2024-04-15T23:32:25.847135+0000","last_fullsized":"2024-04-15T23:32:25.847135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.584090+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:32:26.584090+0000","last_peered":"2024-04-15T23:32:26.584090+0000","last_clean":"2024-04-15T23:32:26.584090+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:32:26.584090+0000","last_undegraded":"2024-04-15T23:32:26.584090+0000","last_fullsized":"2024-04-15T23:32:26.584090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582840+0000","last_change":"2024-04-15T23:32:11.541839+0000","last_active":"2024-04-15T23:32:26.582840+0000","last_peered":"2024-04-15T23:32:26.582840+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.541839+0000","last_became_peered":"2024-04-15T23:32:11.541839+0000","last_unstale":"2024-04-15T23:32:26.582840+0000","last_undegraded":"2024-04-15T23:32:26.582840+0000","last_fullsized":"2024-04-15T23:32:11.539929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:09:23.261218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.583236+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:32:26.583236+0000","last_peered":"2024-04-15T23:32:26.583236+0000","last_clean":"2024-04-15T23:32:26.583236+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:32:26.583236+0000","last_undegraded":"2024-04-15T23:32:26.583236+0000","last_fullsized":"2024-04-15T23:32:26.583236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582970+0000","last_change":"2024-04-15T23:32:11.542084+0000","last_active":"2024-04-15T23:32:26.582970+0000","last_peered":"2024-04-15T23:32:26.582970+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542084+0000","last_became_peered":"2024-04-15T23:32:11.542084+0000","last_unstale":"2024-04-15T23:32:26.582970+0000","last_undegraded":"2024-04-15T23:32:26.582970+0000","last_fullsized":"2024-04-15T23:32:11.539539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:14.580653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846456+0000","last_change":"2024-04-15T23:32:11.545613+0000","last_active":"2024-04-15T23:32:25.846456+0000","last_peered":"2024-04-15T23:32:25.846456+0000","last_clean":"2024-04-15T23:32:07.786183+0000","last_became_active":"2024-04-15T23:32:11.545613+0000","last_became_peered":"2024-04-15T23:32:11.545613+0000","last_unstale":"2024-04-15T23:32:25.846456+0000","last_undegraded":"2024-04-15T23:32:25.846456+0000","last_fullsized":"2024-04-15T23:32:11.542669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:04.145901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583593+0000","last_change":"2024-04-15T23:32:11.543993+0000","last_active":"2024-04-15T23:32:26.583593+0000","last_peered":"2024-04-15T23:32:26.583593+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:32:11.543993+0000","last_became_peered":"2024-04-15T23:32:11.543993+0000","last_unstale":"2024-04-15T23:32:26.583593+0000","last_undegraded":"2024-04-15T23:32:26.583593+0000","last_fullsized":"2024-04-15T23:32:11.540623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:27.827081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":48,"reported_epoch":30,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:25.846995+0000","last_change":"2024-04-15T23:32:11.547544+0000","last_active":"2024-04-15T23:32:25.846995+0000","last_peered":"2024-04-15T23:32:25.846995+0000","last_clean":"2024-04-15T23:32:07.786667+0000","last_became_active":"2024-04-15T23:32:11.547544+0000","last_became_peered":"2024-04-15T23:32:11.547544+0000","last_unstale":"2024-04-15T23:32:25.846995+0000","last_undegraded":"2024-04-15T23:32:11.543672+0000","last_fullsized":"2024-04-15T23:32:11.543587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:40.606451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583639+0000","last_change":"2024-04-15T23:32:11.543376+0000","last_active":"2024-04-15T23:32:26.583639+0000","last_peered":"2024-04-15T23:32:26.583639+0000","last_clean":"2024-04-15T23:32:07.534221+0000","last_became_active":"2024-04-15T23:32:11.543376+0000","last_became_peered":"2024-04-15T23:32:11.543376+0000","last_unstale":"2024-04-15T23:32:26.583639+0000","last_undegraded":"2024-04-15T23:32:26.583639+0000","last_fullsized":"2024-04-15T23:32:11.541450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:45:42.857925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846694+0000","last_change":"2024-04-15T23:32:11.546441+0000","last_active":"2024-04-15T23:32:25.846694+0000","last_peered":"2024-04-15T23:32:25.846694+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.546441+0000","last_became_peered":"2024-04-15T23:32:11.546441+0000","last_unstale":"2024-04-15T23:32:25.846694+0000","last_undegraded":"2024-04-15T23:32:25.846694+0000","last_fullsized":"2024-04-15T23:32:11.543536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:29.042475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847539+0000","last_change":"2024-04-15T23:32:11.546377+0000","last_active":"2024-04-15T23:32:25.847539+0000","last_peered":"2024-04-15T23:32:25.847539+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546377+0000","last_became_peered":"2024-04-15T23:32:11.546377+0000","last_unstale":"2024-04-15T23:32:25.847539+0000","last_undegraded":"2024-04-15T23:32:25.847539+0000","last_fullsized":"2024-04-15T23:32:11.543483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:22:51.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582477+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:32:26.582477+0000","last_peered":"2024-04-15T23:32:26.582477+0000","last_clean":"2024-04-15T23:32:26.582477+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:32:26.582477+0000","last_undegraded":"2024-04-15T23:32:26.582477+0000","last_fullsized":"2024-04-15T23:32:26.582477+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847586+0000","last_change":"2024-04-15T23:32:11.547018+0000","last_active":"2024-04-15T23:32:25.847586+0000","last_peered":"2024-04-15T23:32:25.847586+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547018+0000","last_became_peered":"2024-04-15T23:32:11.547018+0000","last_unstale":"2024-04-15T23:32:25.847586+0000","last_undegraded":"2024-04-15T23:32:25.847586+0000","last_fullsized":"2024-04-15T23:32:11.543473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:46:57.018356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.846635+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:32:25.846635+0000","last_peered":"2024-04-15T23:32:25.846635+0000","last_clean":"2024-04-15T23:32:25.846635+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:32:25.846635+0000","last_undegraded":"2024-04-15T23:32:25.846635+0000","last_fullsized":"2024-04-15T23:32:25.846635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.848079+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:32:25.848079+0000","last_peered":"2024-04-15T23:32:25.848079+0000","last_clean":"2024-04-15T23:32:25.848079+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:32:25.848079+0000","last_undegraded":"2024-04-15T23:32:25.848079+0000","last_fullsized":"2024-04-15T23:32:25.848079+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582780+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:32:26.582780+0000","last_peered":"2024-04-15T23:32:26.582780+0000","last_clean":"2024-04-15T23:32:26.582780+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:32:26.582780+0000","last_undegraded":"2024-04-15T23:32:26.582780+0000","last_fullsized":"2024-04-15T23:32:26.582780+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582578+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:32:26.582578+0000","last_peered":"2024-04-15T23:32:26.582578+0000","last_clean":"2024-04-15T23:32:26.582578+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:32:26.582578+0000","last_undegraded":"2024-04-15T23:32:26.582578+0000","last_fullsized":"2024-04-15T23:32:26.582578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582706+0000","last_change":"2024-04-15T23:32:03.783205+0000","last_active":"2024-04-15T23:32:26.582706+0000","last_peered":"2024-04-15T23:32:26.582706+0000","last_clean":"2024-04-15T23:32:26.582706+0000","last_became_active":"2024-04-15T23:32:03.782934+0000","last_became_peered":"2024-04-15T23:32:03.782934+0000","last_unstale":"2024-04-15T23:32:26.582706+0000","last_undegraded":"2024-04-15T23:32:26.582706+0000","last_fullsized":"2024-04-15T23:32:26.582706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:48:35.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847577+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:32:25.847577+0000","last_peered":"2024-04-15T23:32:25.847577+0000","last_clean":"2024-04-15T23:32:25.847577+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:32:25.847577+0000","last_undegraded":"2024-04-15T23:32:25.847577+0000","last_fullsized":"2024-04-15T23:32:25.847577+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846596+0000","last_change":"2024-04-15T23:32:11.547212+0000","last_active":"2024-04-15T23:32:25.846596+0000","last_peered":"2024-04-15T23:32:25.846596+0000","last_clean":"2024-04-15T23:32:07.786434+0000","last_became_active":"2024-04-15T23:32:11.547212+0000","last_became_peered":"2024-04-15T23:32:11.547212+0000","last_unstale":"2024-04-15T23:32:25.846596+0000","last_undegraded":"2024-04-15T23:32:25.846596+0000","last_fullsized":"2024-04-15T23:32:11.543397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:21.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847705+0000","last_change":"2024-04-15T23:32:11.547400+0000","last_active":"2024-04-15T23:32:25.847705+0000","last_peered":"2024-04-15T23:32:25.847705+0000","last_clean":"2024-04-15T23:32:07.786794+0000","last_became_active":"2024-04-15T23:32:11.547400+0000","last_became_peered":"2024-04-15T23:32:11.547400+0000","last_unstale":"2024-04-15T23:32:25.847705+0000","last_undegraded":"2024-04-15T23:32:25.847705+0000","last_fullsized":"2024-04-15T23:32:11.543649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:18.237296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846416+0000","last_change":"2024-04-15T23:32:11.545235+0000","last_active":"2024-04-15T23:32:25.846416+0000","last_peered":"2024-04-15T23:32:25.846416+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545235+0000","last_became_peered":"2024-04-15T23:32:11.545235+0000","last_unstale":"2024-04-15T23:32:25.846416+0000","last_undegraded":"2024-04-15T23:32:25.846416+0000","last_fullsized":"2024-04-15T23:32:11.542558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:57:44.698682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":28,"reported_epoch":30,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:25.846777+0000","last_change":"2024-04-15T23:32:11.548140+0000","last_active":"2024-04-15T23:32:25.846777+0000","last_peered":"2024-04-15T23:32:25.846777+0000","last_clean":"2024-04-15T23:31:30.873548+0000","last_became_active":"2024-04-15T23:32:11.548140+0000","last_became_peered":"2024-04-15T23:32:11.548140+0000","last_unstale":"2024-04-15T23:32:25.846777+0000","last_undegraded":"2024-04-15T23:32:11.544200+0000","last_fullsized":"2024-04-15T23:32:11.543310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:13:05.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847388+0000","last_change":"2024-04-15T23:32:11.545650+0000","last_active":"2024-04-15T23:32:25.847388+0000","last_peered":"2024-04-15T23:32:25.847388+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:32:11.545650+0000","last_became_peered":"2024-04-15T23:32:11.545650+0000","last_unstale":"2024-04-15T23:32:25.847388+0000","last_undegraded":"2024-04-15T23:32:25.847388+0000","last_fullsized":"2024-04-15T23:32:11.543190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:45:42.857925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":46,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847004+0000","last_change":"2024-04-15T23:32:11.548343+0000","last_active":"2024-04-15T23:32:25.847004+0000","last_peered":"2024-04-15T23:32:25.847004+0000","last_clean":"2024-04-15T23:32:07.786600+0000","last_became_active":"2024-04-15T23:32:11.548343+0000","last_became_peered":"2024-04-15T23:32:11.548343+0000","last_unstale":"2024-04-15T23:32:25.847004+0000","last_undegraded":"2024-04-15T23:32:25.847004+0000","last_fullsized":"2024-04-15T23:32:11.544334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:17:01.902464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847298+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:32:25.847298+0000","last_peered":"2024-04-15T23:32:25.847298+0000","last_clean":"2024-04-15T23:32:25.847298+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:32:25.847298+0000","last_undegraded":"2024-04-15T23:32:25.847298+0000","last_fullsized":"2024-04-15T23:32:25.847298+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582470+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:32:26.582470+0000","last_peered":"2024-04-15T23:32:26.582470+0000","last_clean":"2024-04-15T23:32:26.582470+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:32:26.582470+0000","last_undegraded":"2024-04-15T23:32:26.582470+0000","last_fullsized":"2024-04-15T23:32:26.582470+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.848065+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:32:25.848065+0000","last_peered":"2024-04-15T23:32:25.848065+0000","last_clean":"2024-04-15T23:32:25.848065+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:32:25.848065+0000","last_undegraded":"2024-04-15T23:32:25.848065+0000","last_fullsized":"2024-04-15T23:32:25.848065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582822+0000","last_change":"2024-04-15T23:32:11.542193+0000","last_active":"2024-04-15T23:32:26.582822+0000","last_peered":"2024-04-15T23:32:26.582822+0000","last_clean":"2024-04-15T23:32:07.533690+0000","last_became_active":"2024-04-15T23:32:11.542193+0000","last_became_peered":"2024-04-15T23:32:11.542193+0000","last_unstale":"2024-04-15T23:32:26.582822+0000","last_undegraded":"2024-04-15T23:32:26.582822+0000","last_fullsized":"2024-04-15T23:32:11.539806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:17:23.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583582+0000","last_change":"2024-04-15T23:32:11.543916+0000","last_active":"2024-04-15T23:32:26.583582+0000","last_peered":"2024-04-15T23:32:26.583582+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543916+0000","last_became_peered":"2024-04-15T23:32:11.543916+0000","last_unstale":"2024-04-15T23:32:26.583582+0000","last_undegraded":"2024-04-15T23:32:26.583582+0000","last_fullsized":"2024-04-15T23:32:11.540434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:24:53.954892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":246,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847331+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:32:25.847331+0000","last_peered":"2024-04-15T23:32:25.847331+0000","last_clean":"2024-04-15T23:32:25.847331+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:32:25.847331+0000","last_undegraded":"2024-04-15T23:32:25.847331+0000","last_fullsized":"2024-04-15T23:32:25.847331+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847177+0000","last_change":"2024-04-15T23:32:11.548922+0000","last_active":"2024-04-15T23:32:25.847177+0000","last_peered":"2024-04-15T23:32:25.847177+0000","last_clean":"2024-04-15T23:32:07.786775+0000","last_became_active":"2024-04-15T23:32:11.548922+0000","last_became_peered":"2024-04-15T23:32:11.548922+0000","last_unstale":"2024-04-15T23:32:25.847177+0000","last_undegraded":"2024-04-15T23:32:25.847177+0000","last_fullsized":"2024-04-15T23:32:11.544390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:42:25.823499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582992+0000","last_change":"2024-04-15T23:32:11.542325+0000","last_active":"2024-04-15T23:32:26.582992+0000","last_peered":"2024-04-15T23:32:26.582992+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.542325+0000","last_became_peered":"2024-04-15T23:32:11.542325+0000","last_unstale":"2024-04-15T23:32:26.582992+0000","last_undegraded":"2024-04-15T23:32:26.582992+0000","last_fullsized":"2024-04-15T23:32:11.539842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:52:49.431439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847486+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:32:25.847486+0000","last_peered":"2024-04-15T23:32:25.847486+0000","last_clean":"2024-04-15T23:32:25.847486+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:32:25.847486+0000","last_undegraded":"2024-04-15T23:32:25.847486+0000","last_fullsized":"2024-04-15T23:32:25.847486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847241+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:32:25.847241+0000","last_peered":"2024-04-15T23:32:25.847241+0000","last_clean":"2024-04-15T23:32:25.847241+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:32:25.847241+0000","last_undegraded":"2024-04-15T23:32:25.847241+0000","last_fullsized":"2024-04-15T23:32:25.847241+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846416+0000","last_change":"2024-04-15T23:32:11.545347+0000","last_active":"2024-04-15T23:32:25.846416+0000","last_peered":"2024-04-15T23:32:25.846416+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545347+0000","last_became_peered":"2024-04-15T23:32:11.545347+0000","last_unstale":"2024-04-15T23:32:25.846416+0000","last_undegraded":"2024-04-15T23:32:25.846416+0000","last_fullsized":"2024-04-15T23:32:11.542681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:44:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583519+0000","last_change":"2024-04-15T23:32:11.543852+0000","last_active":"2024-04-15T23:32:26.583519+0000","last_peered":"2024-04-15T23:32:26.583519+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:32:11.543852+0000","last_became_peered":"2024-04-15T23:32:11.543852+0000","last_unstale":"2024-04-15T23:32:26.583519+0000","last_undegraded":"2024-04-15T23:32:26.583519+0000","last_fullsized":"2024-04-15T23:32:11.541322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:17.236231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583139+0000","last_change":"2024-04-15T23:32:11.542965+0000","last_active":"2024-04-15T23:32:26.583139+0000","last_peered":"2024-04-15T23:32:26.583139+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.542965+0000","last_became_peered":"2024-04-15T23:32:11.542965+0000","last_unstale":"2024-04-15T23:32:26.583139+0000","last_undegraded":"2024-04-15T23:32:26.583139+0000","last_fullsized":"2024-04-15T23:32:11.540072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:57:39.420721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582459+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:32:26.582459+0000","last_peered":"2024-04-15T23:32:26.582459+0000","last_clean":"2024-04-15T23:32:26.582459+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:32:26.582459+0000","last_undegraded":"2024-04-15T23:32:26.582459+0000","last_fullsized":"2024-04-15T23:32:26.582459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583363+0000","last_change":"2024-04-15T23:32:11.543464+0000","last_active":"2024-04-15T23:32:26.583363+0000","last_peered":"2024-04-15T23:32:26.583363+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543464+0000","last_became_peered":"2024-04-15T23:32:11.543464+0000","last_unstale":"2024-04-15T23:32:26.583363+0000","last_undegraded":"2024-04-15T23:32:26.583363+0000","last_fullsized":"2024-04-15T23:32:11.540108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:53:35.957069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847170+0000","last_change":"2024-04-15T23:32:11.548935+0000","last_active":"2024-04-15T23:32:25.847170+0000","last_peered":"2024-04-15T23:32:25.847170+0000","last_clean":"2024-04-15T23:32:07.786618+0000","last_became_active":"2024-04-15T23:32:11.548935+0000","last_became_peered":"2024-04-15T23:32:11.548935+0000","last_unstale":"2024-04-15T23:32:25.847170+0000","last_undegraded":"2024-04-15T23:32:25.847170+0000","last_fullsized":"2024-04-15T23:32:11.544475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:10:22.696167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847106+0000","last_change":"2024-04-15T23:32:11.548361+0000","last_active":"2024-04-15T23:32:25.847106+0000","last_peered":"2024-04-15T23:32:25.847106+0000","last_clean":"2024-04-15T23:32:07.786748+0000","last_became_active":"2024-04-15T23:32:11.548361+0000","last_became_peered":"2024-04-15T23:32:11.548361+0000","last_unstale":"2024-04-15T23:32:25.847106+0000","last_undegraded":"2024-04-15T23:32:25.847106+0000","last_fullsized":"2024-04-15T23:32:11.544250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:14:20.393048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583117+0000","last_change":"2024-04-15T23:32:11.542992+0000","last_active":"2024-04-15T23:32:26.583117+0000","last_peered":"2024-04-15T23:32:26.583117+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542992+0000","last_became_peered":"2024-04-15T23:32:11.542992+0000","last_unstale":"2024-04-15T23:32:26.583117+0000","last_undegraded":"2024-04-15T23:32:26.583117+0000","last_fullsized":"2024-04-15T23:32:11.540105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:11.877760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847669+0000","last_change":"2024-04-15T23:32:11.546308+0000","last_active":"2024-04-15T23:32:25.847669+0000","last_peered":"2024-04-15T23:32:25.847669+0000","last_clean":"2024-04-15T23:32:07.786926+0000","last_became_active":"2024-04-15T23:32:11.546308+0000","last_became_peered":"2024-04-15T23:32:11.546308+0000","last_unstale":"2024-04-15T23:32:25.847669+0000","last_undegraded":"2024-04-15T23:32:25.847669+0000","last_fullsized":"2024-04-15T23:32:11.543424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:54.358011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.584155+0000","last_change":"2024-04-15T23:32:11.544222+0000","last_active":"2024-04-15T23:32:26.584155+0000","last_peered":"2024-04-15T23:32:26.584155+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.544222+0000","last_became_peered":"2024-04-15T23:32:11.544222+0000","last_unstale":"2024-04-15T23:32:26.584155+0000","last_undegraded":"2024-04-15T23:32:26.584155+0000","last_fullsized":"2024-04-15T23:32:11.540903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:36.399440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.583217+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:32:26.583217+0000","last_peered":"2024-04-15T23:32:26.583217+0000","last_clean":"2024-04-15T23:32:26.583217+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:32:26.583217+0000","last_undegraded":"2024-04-15T23:32:26.583217+0000","last_fullsized":"2024-04-15T23:32:26.583217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583274+0000","last_change":"2024-04-15T23:32:11.543668+0000","last_active":"2024-04-15T23:32:26.583274+0000","last_peered":"2024-04-15T23:32:26.583274+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.543668+0000","last_became_peered":"2024-04-15T23:32:11.543668+0000","last_unstale":"2024-04-15T23:32:26.583274+0000","last_undegraded":"2024-04-15T23:32:26.583274+0000","last_fullsized":"2024-04-15T23:32:11.540356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:33.896469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583821+0000","last_change":"2024-04-15T23:32:11.546268+0000","last_active":"2024-04-15T23:32:26.583821+0000","last_peered":"2024-04-15T23:32:26.583821+0000","last_clean":"2024-04-15T23:32:07.534420+0000","last_became_active":"2024-04-15T23:32:11.546268+0000","last_became_peered":"2024-04-15T23:32:11.546268+0000","last_unstale":"2024-04-15T23:32:26.583821+0000","last_undegraded":"2024-04-15T23:32:26.583821+0000","last_fullsized":"2024-04-15T23:32:11.542494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:13.964566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582953+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:32:26.582953+0000","last_peered":"2024-04-15T23:32:26.582953+0000","last_clean":"2024-04-15T23:32:26.582953+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:32:26.582953+0000","last_undegraded":"2024-04-15T23:32:26.582953+0000","last_fullsized":"2024-04-15T23:32:26.582953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":28,"reported_epoch":30,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:26.583808+0000","last_change":"2024-04-15T23:32:11.546222+0000","last_active":"2024-04-15T23:32:26.583808+0000","last_peered":"2024-04-15T23:32:26.583808+0000","last_clean":"2024-04-15T23:31:30.875670+0000","last_became_active":"2024-04-15T23:32:11.546222+0000","last_became_peered":"2024-04-15T23:32:11.546222+0000","last_unstale":"2024-04-15T23:32:26.583808+0000","last_undegraded":"2024-04-15T23:32:11.541817+0000","last_fullsized":"2024-04-15T23:32:11.540942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:24:19.706517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.584110+0000","last_change":"2024-04-15T23:32:11.546473+0000","last_active":"2024-04-15T23:32:26.584110+0000","last_peered":"2024-04-15T23:32:26.584110+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.546473+0000","last_became_peered":"2024-04-15T23:32:11.546473+0000","last_unstale":"2024-04-15T23:32:26.584110+0000","last_undegraded":"2024-04-15T23:32:26.584110+0000","last_fullsized":"2024-04-15T23:32:11.541882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:07.371350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846174+0000","last_change":"2024-04-15T23:32:11.544726+0000","last_active":"2024-04-15T23:32:25.846174+0000","last_peered":"2024-04-15T23:32:25.846174+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544726+0000","last_became_peered":"2024-04-15T23:32:11.544726+0000","last_unstale":"2024-04-15T23:32:25.846174+0000","last_undegraded":"2024-04-15T23:32:25.846174+0000","last_fullsized":"2024-04-15T23:32:11.542306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:11.877760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'3","reported_seq":39,"reported_epoch":30,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:25.847600+0000","last_change":"2024-04-15T23:32:11.547480+0000","last_active":"2024-04-15T23:32:25.847600+0000","last_peered":"2024-04-15T23:32:25.847600+0000","last_clean":"2024-04-15T23:31:56.677189+0000","last_became_active":"2024-04-15T23:32:11.547480+0000","last_became_peered":"2024-04-15T23:32:11.547480+0000","last_unstale":"2024-04-15T23:32:25.847600+0000","last_undegraded":"2024-04-15T23:32:11.543622+0000","last_fullsized":"2024-04-15T23:32:11.543547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:11.644081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.848397+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:32:25.848397+0000","last_peered":"2024-04-15T23:32:25.848397+0000","last_clean":"2024-04-15T23:32:25.848397+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:32:25.848397+0000","last_undegraded":"2024-04-15T23:32:25.848397+0000","last_fullsized":"2024-04-15T23:32:25.848397+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582810+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:32:26.582810+0000","last_peered":"2024-04-15T23:32:26.582810+0000","last_clean":"2024-04-15T23:32:26.582810+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:32:26.582810+0000","last_undegraded":"2024-04-15T23:32:26.582810+0000","last_fullsized":"2024-04-15T23:32:26.582810+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.846679+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:32:25.846679+0000","last_peered":"2024-04-15T23:32:25.846679+0000","last_clean":"2024-04-15T23:32:25.846679+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:32:25.846679+0000","last_undegraded":"2024-04-15T23:32:25.846679+0000","last_fullsized":"2024-04-15T23:32:25.846679+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'10","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:25.847602+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:32:25.847602+0000","last_peered":"2024-04-15T23:32:25.847602+0000","last_clean":"2024-04-15T23:32:25.847602+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:32:25.847602+0000","last_undegraded":"2024-04-15T23:32:25.847602+0000","last_fullsized":"2024-04-15T23:32:25.847602+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582750+0000","last_change":"2024-04-15T23:32:11.542068+0000","last_active":"2024-04-15T23:32:26.582750+0000","last_peered":"2024-04-15T23:32:26.582750+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542068+0000","last_became_peered":"2024-04-15T23:32:11.542068+0000","last_unstale":"2024-04-15T23:32:26.582750+0000","last_undegraded":"2024-04-15T23:32:26.582750+0000","last_fullsized":"2024-04-15T23:32:11.539597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:16:50.754369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582588+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:32:26.582588+0000","last_peered":"2024-04-15T23:32:26.582588+0000","last_clean":"2024-04-15T23:32:26.582588+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:32:26.582588+0000","last_undegraded":"2024-04-15T23:32:26.582588+0000","last_fullsized":"2024-04-15T23:32:26.582588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.848365+0000","last_change":"2024-04-15T23:32:11.548236+0000","last_active":"2024-04-15T23:32:25.848365+0000","last_peered":"2024-04-15T23:32:25.848365+0000","last_clean":"2024-04-15T23:32:07.787053+0000","last_became_active":"2024-04-15T23:32:11.548236+0000","last_became_peered":"2024-04-15T23:32:11.548236+0000","last_unstale":"2024-04-15T23:32:25.848365+0000","last_undegraded":"2024-04-15T23:32:25.848365+0000","last_fullsized":"2024-04-15T23:32:11.544657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:01.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846236+0000","last_change":"2024-04-15T23:32:11.544436+0000","last_active":"2024-04-15T23:32:25.846236+0000","last_peered":"2024-04-15T23:32:25.846236+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544436+0000","last_became_peered":"2024-04-15T23:32:11.544436+0000","last_unstale":"2024-04-15T23:32:25.846236+0000","last_undegraded":"2024-04-15T23:32:25.846236+0000","last_fullsized":"2024-04-15T23:32:11.542388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:52:50.436669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847627+0000","last_change":"2024-04-15T23:32:11.546257+0000","last_active":"2024-04-15T23:32:25.847627+0000","last_peered":"2024-04-15T23:32:25.847627+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.546257+0000","last_became_peered":"2024-04-15T23:32:11.546257+0000","last_unstale":"2024-04-15T23:32:25.847627+0000","last_undegraded":"2024-04-15T23:32:25.847627+0000","last_fullsized":"2024-04-15T23:32:11.543657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:17.519004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582606+0000","last_change":"2024-04-15T23:32:11.540897+0000","last_active":"2024-04-15T23:32:26.582606+0000","last_peered":"2024-04-15T23:32:26.582606+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.540897+0000","last_became_peered":"2024-04-15T23:32:11.540897+0000","last_unstale":"2024-04-15T23:32:26.582606+0000","last_undegraded":"2024-04-15T23:32:26.582606+0000","last_fullsized":"2024-04-15T23:32:11.539469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:39:20.518476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.584283+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:32:26.584283+0000","last_peered":"2024-04-15T23:32:26.584283+0000","last_clean":"2024-04-15T23:32:26.584283+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:32:26.584283+0000","last_undegraded":"2024-04-15T23:32:26.584283+0000","last_fullsized":"2024-04-15T23:32:26.584283+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582991+0000","last_change":"2024-04-15T23:32:11.543133+0000","last_active":"2024-04-15T23:32:26.582991+0000","last_peered":"2024-04-15T23:32:26.582991+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.543133+0000","last_became_peered":"2024-04-15T23:32:11.543133+0000","last_unstale":"2024-04-15T23:32:26.582991+0000","last_undegraded":"2024-04-15T23:32:26.582991+0000","last_fullsized":"2024-04-15T23:32:11.540630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:00.931096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.847960+0000","last_change":"2024-04-15T23:32:11.547180+0000","last_active":"2024-04-15T23:32:25.847960+0000","last_peered":"2024-04-15T23:32:25.847960+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:32:25.847960+0000","last_undegraded":"2024-04-15T23:32:25.847960+0000","last_fullsized":"2024-04-15T23:32:11.544284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:24:20.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846513+0000","last_change":"2024-04-15T23:32:11.545332+0000","last_active":"2024-04-15T23:32:25.846513+0000","last_peered":"2024-04-15T23:32:25.846513+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545332+0000","last_became_peered":"2024-04-15T23:32:11.545332+0000","last_unstale":"2024-04-15T23:32:25.846513+0000","last_undegraded":"2024-04-15T23:32:25.846513+0000","last_fullsized":"2024-04-15T23:32:11.542751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:17:29.563001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.583517+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:32:26.583517+0000","last_peered":"2024-04-15T23:32:26.583517+0000","last_clean":"2024-04-15T23:32:26.583517+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:32:26.583517+0000","last_undegraded":"2024-04-15T23:32:26.583517+0000","last_fullsized":"2024-04-15T23:32:26.583517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":47,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583324+0000","last_change":"2024-04-15T23:32:11.543424+0000","last_active":"2024-04-15T23:32:26.583324+0000","last_peered":"2024-04-15T23:32:26.583324+0000","last_clean":"2024-04-15T23:32:07.533959+0000","last_became_active":"2024-04-15T23:32:11.543424+0000","last_became_peered":"2024-04-15T23:32:11.543424+0000","last_unstale":"2024-04-15T23:32:26.583324+0000","last_undegraded":"2024-04-15T23:32:26.583324+0000","last_fullsized":"2024-04-15T23:32:11.540315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:44:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583539+0000","last_change":"2024-04-15T23:32:11.543802+0000","last_active":"2024-04-15T23:32:26.583539+0000","last_peered":"2024-04-15T23:32:26.583539+0000","last_clean":"2024-04-15T23:32:07.533902+0000","last_became_active":"2024-04-15T23:32:11.543802+0000","last_became_peered":"2024-04-15T23:32:11.543802+0000","last_unstale":"2024-04-15T23:32:26.583539+0000","last_undegraded":"2024-04-15T23:32:26.583539+0000","last_fullsized":"2024-04-15T23:32:11.540623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:04.145901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582468+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:32:26.582468+0000","last_peered":"2024-04-15T23:32:26.582468+0000","last_clean":"2024-04-15T23:32:26.582468+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:32:26.582468+0000","last_undegraded":"2024-04-15T23:32:26.582468+0000","last_fullsized":"2024-04-15T23:32:26.582468+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846817+0000","last_change":"2024-04-15T23:32:11.545464+0000","last_active":"2024-04-15T23:32:25.846817+0000","last_peered":"2024-04-15T23:32:25.846817+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:32:11.545464+0000","last_became_peered":"2024-04-15T23:32:11.545464+0000","last_unstale":"2024-04-15T23:32:25.846817+0000","last_undegraded":"2024-04-15T23:32:25.846817+0000","last_fullsized":"2024-04-15T23:32:11.542953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":48,"reported_epoch":30,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:25.847415+0000","last_change":"2024-04-15T23:32:11.547001+0000","last_active":"2024-04-15T23:32:25.847415+0000","last_peered":"2024-04-15T23:32:25.847415+0000","last_clean":"2024-04-15T23:32:07.786711+0000","last_became_active":"2024-04-15T23:32:11.547001+0000","last_became_peered":"2024-04-15T23:32:11.547001+0000","last_unstale":"2024-04-15T23:32:25.847415+0000","last_undegraded":"2024-04-15T23:32:11.543553+0000","last_fullsized":"2024-04-15T23:32:11.543469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:04:01.920070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846841+0000","last_change":"2024-04-15T23:32:11.547235+0000","last_active":"2024-04-15T23:32:25.846841+0000","last_peered":"2024-04-15T23:32:25.846841+0000","last_clean":"2024-04-15T23:32:07.786529+0000","last_became_active":"2024-04-15T23:32:11.547235+0000","last_became_peered":"2024-04-15T23:32:11.547235+0000","last_unstale":"2024-04-15T23:32:25.846841+0000","last_undegraded":"2024-04-15T23:32:25.846841+0000","last_fullsized":"2024-04-15T23:32:11.544228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:51:42.570150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-15T23:32:26.582725+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:32:26.582725+0000","last_peered":"2024-04-15T23:32:26.582725+0000","last_clean":"2024-04-15T23:32:26.582725+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:32:26.582725+0000","last_undegraded":"2024-04-15T23:32:26.582725+0000","last_fullsized":"2024-04-15T23:32:26.582725+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.582939+0000","last_change":"2024-04-15T23:32:11.543217+0000","last_active":"2024-04-15T23:32:26.582939+0000","last_peered":"2024-04-15T23:32:26.582939+0000","last_clean":"2024-04-15T23:32:07.533827+0000","last_became_active":"2024-04-15T23:32:11.543217+0000","last_became_peered":"2024-04-15T23:32:11.543217+0000","last_unstale":"2024-04-15T23:32:26.582939+0000","last_undegraded":"2024-04-15T23:32:26.582939+0000","last_fullsized":"2024-04-15T23:32:11.539906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:27:36.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":18,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:26.583577+0000","last_change":"2024-04-15T23:32:11.545980+0000","last_active":"2024-04-15T23:32:26.583577+0000","last_peered":"2024-04-15T23:32:26.583577+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545980+0000","last_became_peered":"2024-04-15T23:32:11.545980+0000","last_unstale":"2024-04-15T23:32:26.583577+0000","last_undegraded":"2024-04-15T23:32:26.583577+0000","last_fullsized":"2024-04-15T23:32:11.541496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:04:01.920070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":44,"reported_epoch":30,"state":"active+undersized","last_fresh":"2024-04-15T23:32:25.846679+0000","last_change":"2024-04-15T23:32:11.548138+0000","last_active":"2024-04-15T23:32:25.846679+0000","last_peered":"2024-04-15T23:32:25.846679+0000","last_clean":"2024-04-15T23:32:07.786282+0000","last_became_active":"2024-04-15T23:32:11.548138+0000","last_became_peered":"2024-04-15T23:32:11.548138+0000","last_unstale":"2024-04-15T23:32:25.846679+0000","last_undegraded":"2024-04-15T23:32:25.846679+0000","last_fullsized":"2024-04-15T23:32:11.544570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:06.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":28,"reported_epoch":30,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:25.847965+0000","last_change":"2024-04-15T23:32:11.547071+0000","last_active":"2024-04-15T23:32:25.847965+0000","last_peered":"2024-04-15T23:32:25.847965+0000","last_clean":"2024-04-15T23:31:30.875139+0000","last_became_active":"2024-04-15T23:32:11.547071+0000","last_became_peered":"2024-04-15T23:32:11.547071+0000","last_unstale":"2024-04-15T23:32:25.847965+0000","last_undegraded":"2024-04-15T23:32:11.544177+0000","last_fullsized":"2024-04-15T23:32:11.543927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:26.821850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":43,"acting":43,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":204800,"data_stored":80548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738385,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":884736,"data_stored":708903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":876544,"data_stored":708287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:32:32.410 INFO:tasks.thrashosds.thrasher:Setting 4.33 to [2, 0, 1] 2024-04-15T23:32:32.411 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.33', '2', '0', '1'] 2024-04-15T23:32:32.411 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.33 2 0 1 2024-04-15T23:32:32.412 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:32.412 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:32.412 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:32.412 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:32.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:32.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:32.496 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:32.513+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:32.560 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:32.560 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:32.560 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:32.560 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:32.560 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:32.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:32.578 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:32.579 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:32.596 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:32.613+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:32.596 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:32.597 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:32.597 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:32.601 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:32.601 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:32.697 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:32.714+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:32.718 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:32.718 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:32.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:32.777 INFO:teuthology.orchestra.run.smithi102.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-15T23:32:32.783 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-15T23:32:32.783 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-15T23:32:32.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-04-15T23:32:32.797 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:32.815+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:32.838 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:32.838 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:32.847 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:32.899 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:32.915+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:32.955 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:32.955 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:32.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:33.000 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:33.017+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:33.101 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:33.118+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:33.113 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.113 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.122 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:33.202 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:33.219+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:33.233 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.233 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:33.303 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:33.319+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:33.350 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.350 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.359 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:33.403 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:33.420+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:33.467 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.468 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.476 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:33.521 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:33.538+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:33.586 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.586 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.595 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:33.606 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:33.623+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:33.706 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:33.723+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:33.743 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.743 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:33.807 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:33.824+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:33.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:32:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.862 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:33.914 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:33.931+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:33.980 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:33.980 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:33.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:34.029 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.046+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.110 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.127+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.137 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:34.137 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:34.146 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:34.230 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.247+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.295 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:34.295 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:34.304 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:34.347 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:34.364+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:34.413 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.431+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.416 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:34.416 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:34.425 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:34.514 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.531+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.573 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:34.573 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:34.583 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:34.602 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:34.615 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.632+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.691 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:34.691 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:34.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:34.716 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:34.732+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:34.748 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:34.748 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:34.767 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:34.767 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:34.767 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:34.771 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:34.771 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:34.809 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:34.809 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:34.809 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:34.809 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:34.816 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:34.833+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:34.818 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:34.844 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:32:34.917 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:34.935+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:34.966 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:34.966 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:34.966 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:34.966 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:34.966 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:34.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:35.018 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:35.035+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.030562928999998, 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:35.085 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.086 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.087 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.088 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.090 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:35.090 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:35.090 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.091 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.030481441000006, 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.092 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.093 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.094 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.095 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.096 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.097 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232389749999996, 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.098 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.099 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:35.100 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:35.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.102 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.102 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:35.102 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:35.102 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.102 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:35.103 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232341759999997, 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:35.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232303461000001, 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:35.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:35.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232264673000003, 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:35.115 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.118 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:35.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.120 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232241341999995, 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:35.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:35.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:35.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232210856999998, 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:35.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:35.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:35.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.131 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232175788000006, 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232152045000007, 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232127786000007, 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232099446999996, 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:35.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:35.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.151 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232060648000001, 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:35.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.156 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.232025476999993, 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:35.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:35.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.161 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.231992109000004, 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:35.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:35.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.231934648000006, 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:35.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.230298988000001, 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:35.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:35.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:35.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.229407456000004, 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:35.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.229356108000005, 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:35.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 64.229317992000006, 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:35.190 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:35.192 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:35.209+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:35.192 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:35.293 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:35.310+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:35.303 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:35.303 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:35.303 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:35.303 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:35.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:35.394 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:35.411+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:35.419 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:35.419 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:35.419 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:35.419 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:35.419 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:35.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:35.511 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:35.528+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:35.578 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:35.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.522314876999999, 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.521622332999996, 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:35.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:35.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:35.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.521230419000005, 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.589 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:35.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:35.594 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.520895973999998, 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:35.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:35.599 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.519600620999995, 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:35.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:35.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:35.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.167334757999996, 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:35.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:35.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.167111755999997, 2024-04-15T23:32:35.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:35.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.166670913000004, 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:35.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.619 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.166018956000002, 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:35.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:35.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.165212689000001, 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:35.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:35.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.163112194999997, 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:35.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.634 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725648117000006, 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:35.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:35.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725591373, 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:35.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725480216999998, 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:35.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:35.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725393202999996, 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:35.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.661 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725359502000003, 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:35.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:35.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.667 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725170962999997, 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:35.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:35.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.673 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725126744999997, 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:35.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:35.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725086246000004, 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:35.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.725044535999999, 2024-04-15T23:32:35.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:35.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:35.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:35.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:35.689 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:35.690 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:35.707+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:35.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:35.791 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:35.808+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:35.801 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:35.802 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:35.802 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:35.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:35.895 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:35.912+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:35.959 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:35.959 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:35.959 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:35.959 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:35.959 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:35.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:35.993 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:36.010+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:36.094 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:36.111+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.066039606999993, 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:36.120 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 70.065958119000001, 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267866428000005, 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267818438000006, 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.136 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267780138999996, 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267741350999998, 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.146 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267718020000004, 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.151 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267687534999993, 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.156 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:36.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267652466000001, 2024-04-15T23:32:36.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267628723000001, 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:36.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:36.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:36.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:36.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267604464000001, 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267576125000005, 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267537325999996, 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:36.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267502155000003, 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:36.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.191 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267468786999999, 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:36.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.267411326000001, 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.265775665999996, 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:36.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:36.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.264884133999999, 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:36.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:36.212 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.264832785999999, 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:36.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:36.217 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 65.264794670000001, 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:36.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:36.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:36.221 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:36.222 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:36.223 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:36.239+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:36.323 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:36.340+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:36.337 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:36.337 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:36.337 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:36.337 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:36.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:36.424 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:36.441+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:36.495 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:36.495 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:36.495 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:36.495 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:36.495 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:36.504 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:36.525 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:36.542+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.558188424999997, 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:36.614 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.618 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.557495880999994, 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:36.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.557103967000003, 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.623 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:36.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:36.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:36.627 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.556769521999996, 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:36.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:36.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.555474169000007, 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:36.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:36.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:36.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:36.636 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.203208305999993, 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.640 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.202985303999995, 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:36.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:36.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:36.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.202544461000002, 2024-04-15T23:32:36.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:36.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.650 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.201892504, 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:36.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.201086236999998, 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:36.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:36.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.198985742999994, 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:36.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:36.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.663 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761521665000004, 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:36.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761464920999998, 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:36.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:36.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:36.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761353764999996, 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:36.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:36.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:36.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761266750999994, 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:36.679 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.684 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761233050000001, 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:36.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761044510999994, 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.690 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:36.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:36.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.697 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.697 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:36.697 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.761000292999995, 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:36.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.760959794000001, 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:36.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:36.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.760918083999996, 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:36.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:36.710 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:36.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:36.713 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:36.729+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:36.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:36.813 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:36.830+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:36.823 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:36.823 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:36.823 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:36.832 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:36.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:32:36.902 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:36.902 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:36.914 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:36.930+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:36.934 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:36.934 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:36.934 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:36.938 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:36.939 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:36.940 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:36.940 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:36.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:37.033 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:37.050+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:37.098 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.098 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.107 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:37.151 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:37.168+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:37.217 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:37.235+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:37.224 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.224 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.234 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:37.318 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:37.335+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:37.382 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.382 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:37.432 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:37.449+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:37.520 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:37.537+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:37.540 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.540 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.548 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:37.621 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:37.638+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:37.657 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.657 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:37.722 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:37.739+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:37.776 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.776 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:37.785 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:37.785 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:37.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:32:37.824 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:37.840+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:37.851 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:32:37.924 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:37.941+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:37.933 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:37.933 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:37.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:38.025 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:38.043+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:38.053 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.054 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:38.110 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:38.112 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:32:38.121 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-15T23:32:37.866354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597719,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":99652,"kb_used_data":1952,"kb_used_omap":4,"kb_used_meta":97659,"kb_avail":283015868,"statfs":{"total":289910292480,"available":289808248832,"internally_reserved":0,"allocated":1998848,"data_stored":1514702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4785,"internal_metadata":100003151},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.086677"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858532+0000","last_change":"2024-04-15T23:32:11.544352+0000","last_active":"2024-04-15T23:32:31.858532+0000","last_peered":"2024-04-15T23:32:31.858532+0000","last_clean":"2024-04-15T23:32:07.534338+0000","last_became_active":"2024-04-15T23:32:11.544352+0000","last_became_peered":"2024-04-15T23:32:11.544352+0000","last_unstale":"2024-04-15T23:32:31.858532+0000","last_undegraded":"2024-04-15T23:32:31.858532+0000","last_fullsized":"2024-04-15T23:32:11.541160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:46:57.018356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857762+0000","last_change":"2024-04-15T23:32:11.543124+0000","last_active":"2024-04-15T23:32:31.857762+0000","last_peered":"2024-04-15T23:32:31.857762+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:32:11.543124+0000","last_became_peered":"2024-04-15T23:32:11.543124+0000","last_unstale":"2024-04-15T23:32:31.857762+0000","last_undegraded":"2024-04-15T23:32:31.857762+0000","last_fullsized":"2024-04-15T23:32:11.541073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:17:30.568231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788869+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:32:32.788869+0000","last_peered":"2024-04-15T23:32:32.788869+0000","last_clean":"2024-04-15T23:32:32.788869+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:32:32.788869+0000","last_undegraded":"2024-04-15T23:32:32.788869+0000","last_fullsized":"2024-04-15T23:32:32.788869+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788678+0000","last_change":"2024-04-15T23:32:11.545419+0000","last_active":"2024-04-15T23:32:32.788678+0000","last_peered":"2024-04-15T23:32:32.788678+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:32:11.545419+0000","last_became_peered":"2024-04-15T23:32:11.545419+0000","last_unstale":"2024-04-15T23:32:32.788678+0000","last_undegraded":"2024-04-15T23:32:32.788678+0000","last_fullsized":"2024-04-15T23:32:11.542769+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:34.901699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857978+0000","last_change":"2024-04-15T23:32:11.543474+0000","last_active":"2024-04-15T23:32:31.857978+0000","last_peered":"2024-04-15T23:32:31.857978+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:32:11.543474+0000","last_became_peered":"2024-04-15T23:32:11.543474+0000","last_unstale":"2024-04-15T23:32:31.857978+0000","last_undegraded":"2024-04-15T23:32:31.857978+0000","last_fullsized":"2024-04-15T23:32:11.540447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788168+0000","last_change":"2024-04-15T23:32:11.545668+0000","last_active":"2024-04-15T23:32:32.788168+0000","last_peered":"2024-04-15T23:32:32.788168+0000","last_clean":"2024-04-15T23:32:07.786325+0000","last_became_active":"2024-04-15T23:32:11.545668+0000","last_became_peered":"2024-04-15T23:32:11.545668+0000","last_unstale":"2024-04-15T23:32:32.788168+0000","last_undegraded":"2024-04-15T23:32:32.788168+0000","last_fullsized":"2024-04-15T23:32:11.542733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:01.936327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788626+0000","last_change":"2024-04-15T23:32:11.546347+0000","last_active":"2024-04-15T23:32:32.788626+0000","last_peered":"2024-04-15T23:32:32.788626+0000","last_clean":"2024-04-15T23:32:07.786350+0000","last_became_active":"2024-04-15T23:32:11.546347+0000","last_became_peered":"2024-04-15T23:32:11.546347+0000","last_unstale":"2024-04-15T23:32:32.788626+0000","last_undegraded":"2024-04-15T23:32:32.788626+0000","last_fullsized":"2024-04-15T23:32:11.543107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:17.236231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788095+0000","last_change":"2024-04-15T23:32:11.545203+0000","last_active":"2024-04-15T23:32:32.788095+0000","last_peered":"2024-04-15T23:32:32.788095+0000","last_clean":"2024-04-15T23:32:07.786081+0000","last_became_active":"2024-04-15T23:32:11.545203+0000","last_became_peered":"2024-04-15T23:32:11.545203+0000","last_unstale":"2024-04-15T23:32:32.788095+0000","last_undegraded":"2024-04-15T23:32:32.788095+0000","last_fullsized":"2024-04-15T23:32:11.542426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:27:36.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858770+0000","last_change":"2024-04-15T23:32:11.545953+0000","last_active":"2024-04-15T23:32:31.858770+0000","last_peered":"2024-04-15T23:32:31.858770+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545953+0000","last_became_peered":"2024-04-15T23:32:11.545953+0000","last_unstale":"2024-04-15T23:32:31.858770+0000","last_undegraded":"2024-04-15T23:32:31.858770+0000","last_fullsized":"2024-04-15T23:32:11.541547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:55.363242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857921+0000","last_change":"2024-04-15T23:32:11.543541+0000","last_active":"2024-04-15T23:32:31.857921+0000","last_peered":"2024-04-15T23:32:31.857921+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:32:11.543541+0000","last_became_peered":"2024-04-15T23:32:11.543541+0000","last_unstale":"2024-04-15T23:32:31.857921+0000","last_undegraded":"2024-04-15T23:32:31.857921+0000","last_fullsized":"2024-04-15T23:32:11.541225+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:18.524235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788969+0000","last_change":"2024-04-15T23:32:11.545422+0000","last_active":"2024-04-15T23:32:32.788969+0000","last_peered":"2024-04-15T23:32:32.788969+0000","last_clean":"2024-04-15T23:32:07.786647+0000","last_became_active":"2024-04-15T23:32:11.545422+0000","last_became_peered":"2024-04-15T23:32:11.545422+0000","last_unstale":"2024-04-15T23:32:32.788969+0000","last_undegraded":"2024-04-15T23:32:32.788969+0000","last_fullsized":"2024-04-15T23:32:11.543014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:53:35.957069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857929+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:32:31.857929+0000","last_peered":"2024-04-15T23:32:31.857929+0000","last_clean":"2024-04-15T23:32:31.857929+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:32:31.857929+0000","last_undegraded":"2024-04-15T23:32:31.857929+0000","last_fullsized":"2024-04-15T23:32:31.857929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857686+0000","last_change":"2024-04-15T23:32:11.543005+0000","last_active":"2024-04-15T23:32:31.857686+0000","last_peered":"2024-04-15T23:32:31.857686+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:32:11.543005+0000","last_became_peered":"2024-04-15T23:32:11.543005+0000","last_unstale":"2024-04-15T23:32:31.857686+0000","last_undegraded":"2024-04-15T23:32:31.857686+0000","last_fullsized":"2024-04-15T23:32:11.540304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:35:52.653842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788236+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:32:32.788236+0000","last_peered":"2024-04-15T23:32:32.788236+0000","last_clean":"2024-04-15T23:32:32.788236+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:32:32.788236+0000","last_undegraded":"2024-04-15T23:32:32.788236+0000","last_fullsized":"2024-04-15T23:32:32.788236+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788627+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:32:32.788627+0000","last_peered":"2024-04-15T23:32:32.788627+0000","last_clean":"2024-04-15T23:32:32.788627+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:32:32.788627+0000","last_undegraded":"2024-04-15T23:32:32.788627+0000","last_fullsized":"2024-04-15T23:32:32.788627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788153+0000","last_change":"2024-04-15T23:32:11.546233+0000","last_active":"2024-04-15T23:32:32.788153+0000","last_peered":"2024-04-15T23:32:32.788153+0000","last_clean":"2024-04-15T23:32:07.786096+0000","last_became_active":"2024-04-15T23:32:11.546233+0000","last_became_peered":"2024-04-15T23:32:11.546233+0000","last_unstale":"2024-04-15T23:32:32.788153+0000","last_undegraded":"2024-04-15T23:32:32.788153+0000","last_fullsized":"2024-04-15T23:32:11.542583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:41.677401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858327+0000","last_change":"2024-04-15T23:32:11.543951+0000","last_active":"2024-04-15T23:32:31.858327+0000","last_peered":"2024-04-15T23:32:31.858327+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543951+0000","last_became_peered":"2024-04-15T23:32:11.543951+0000","last_unstale":"2024-04-15T23:32:31.858327+0000","last_undegraded":"2024-04-15T23:32:31.858327+0000","last_fullsized":"2024-04-15T23:32:11.540820+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:22:51.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858449+0000","last_change":"2024-04-15T23:32:11.546238+0000","last_active":"2024-04-15T23:32:31.858449+0000","last_peered":"2024-04-15T23:32:31.858449+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:32:11.546238+0000","last_became_peered":"2024-04-15T23:32:11.546238+0000","last_unstale":"2024-04-15T23:32:31.858449+0000","last_undegraded":"2024-04-15T23:32:31.858449+0000","last_fullsized":"2024-04-15T23:32:11.541553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:51:42.570150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857985+0000","last_change":"2024-04-15T23:32:11.546015+0000","last_active":"2024-04-15T23:32:31.857985+0000","last_peered":"2024-04-15T23:32:31.857985+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:32:31.857985+0000","last_undegraded":"2024-04-15T23:32:31.857985+0000","last_fullsized":"2024-04-15T23:32:11.541074+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:30.047705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788838+0000","last_change":"2024-04-15T23:32:11.546261+0000","last_active":"2024-04-15T23:32:32.788838+0000","last_peered":"2024-04-15T23:32:32.788838+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:32:11.546261+0000","last_became_peered":"2024-04-15T23:32:11.546261+0000","last_unstale":"2024-04-15T23:32:32.788838+0000","last_undegraded":"2024-04-15T23:32:32.788838+0000","last_fullsized":"2024-04-15T23:32:11.542768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:24:53.954892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788846+0000","last_change":"2024-04-15T23:32:11.545687+0000","last_active":"2024-04-15T23:32:32.788846+0000","last_peered":"2024-04-15T23:32:32.788846+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:32:11.545687+0000","last_became_peered":"2024-04-15T23:32:11.545687+0000","last_unstale":"2024-04-15T23:32:32.788846+0000","last_undegraded":"2024-04-15T23:32:32.788846+0000","last_fullsized":"2024-04-15T23:32:11.543335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:35:52.653842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857622+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:32:31.857622+0000","last_peered":"2024-04-15T23:32:31.857622+0000","last_clean":"2024-04-15T23:32:31.857622+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:32:31.857622+0000","last_undegraded":"2024-04-15T23:32:31.857622+0000","last_fullsized":"2024-04-15T23:32:31.857622+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788028+0000","last_change":"2024-04-15T23:32:11.543830+0000","last_active":"2024-04-15T23:32:32.788028+0000","last_peered":"2024-04-15T23:32:32.788028+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543830+0000","last_became_peered":"2024-04-15T23:32:11.543830+0000","last_unstale":"2024-04-15T23:32:32.788028+0000","last_undegraded":"2024-04-15T23:32:32.788028+0000","last_fullsized":"2024-04-15T23:32:11.542394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:14.580653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857355+0000","last_change":"2024-04-15T23:32:11.541949+0000","last_active":"2024-04-15T23:32:31.857355+0000","last_peered":"2024-04-15T23:32:31.857355+0000","last_clean":"2024-04-15T23:32:07.533578+0000","last_became_active":"2024-04-15T23:32:11.541949+0000","last_became_peered":"2024-04-15T23:32:11.541949+0000","last_unstale":"2024-04-15T23:32:31.857355+0000","last_undegraded":"2024-04-15T23:32:31.857355+0000","last_fullsized":"2024-04-15T23:32:11.539550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:40:09.112117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858800+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:32:31.858800+0000","last_peered":"2024-04-15T23:32:31.858800+0000","last_clean":"2024-04-15T23:32:31.858800+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:32:31.858800+0000","last_undegraded":"2024-04-15T23:32:31.858800+0000","last_fullsized":"2024-04-15T23:32:31.858800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789780+0000","last_change":"2024-04-15T23:32:11.548257+0000","last_active":"2024-04-15T23:32:32.789780+0000","last_peered":"2024-04-15T23:32:32.789780+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:32:32.789780+0000","last_undegraded":"2024-04-15T23:32:32.789780+0000","last_fullsized":"2024-04-15T23:32:11.544630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:29:48.946199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788976+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:32:32.788976+0000","last_peered":"2024-04-15T23:32:32.788976+0000","last_clean":"2024-04-15T23:32:32.788976+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:32:32.788976+0000","last_undegraded":"2024-04-15T23:32:32.788976+0000","last_fullsized":"2024-04-15T23:32:32.788976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858364+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:32:31.858364+0000","last_peered":"2024-04-15T23:32:31.858364+0000","last_clean":"2024-04-15T23:32:31.858364+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:32:31.858364+0000","last_undegraded":"2024-04-15T23:32:31.858364+0000","last_fullsized":"2024-04-15T23:32:31.858364+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857506+0000","last_change":"2024-04-15T23:32:11.541839+0000","last_active":"2024-04-15T23:32:31.857506+0000","last_peered":"2024-04-15T23:32:31.857506+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.541839+0000","last_became_peered":"2024-04-15T23:32:11.541839+0000","last_unstale":"2024-04-15T23:32:31.857506+0000","last_undegraded":"2024-04-15T23:32:31.857506+0000","last_fullsized":"2024-04-15T23:32:11.539929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:09:23.261218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857824+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:32:31.857824+0000","last_peered":"2024-04-15T23:32:31.857824+0000","last_clean":"2024-04-15T23:32:31.857824+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:32:31.857824+0000","last_undegraded":"2024-04-15T23:32:31.857824+0000","last_fullsized":"2024-04-15T23:32:31.857824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857343+0000","last_change":"2024-04-15T23:32:11.542084+0000","last_active":"2024-04-15T23:32:31.857343+0000","last_peered":"2024-04-15T23:32:31.857343+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542084+0000","last_became_peered":"2024-04-15T23:32:11.542084+0000","last_unstale":"2024-04-15T23:32:31.857343+0000","last_undegraded":"2024-04-15T23:32:31.857343+0000","last_fullsized":"2024-04-15T23:32:11.539539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:14.580653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788269+0000","last_change":"2024-04-15T23:32:11.545613+0000","last_active":"2024-04-15T23:32:32.788269+0000","last_peered":"2024-04-15T23:32:32.788269+0000","last_clean":"2024-04-15T23:32:07.786183+0000","last_became_active":"2024-04-15T23:32:11.545613+0000","last_became_peered":"2024-04-15T23:32:11.545613+0000","last_unstale":"2024-04-15T23:32:32.788269+0000","last_undegraded":"2024-04-15T23:32:32.788269+0000","last_fullsized":"2024-04-15T23:32:11.542669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:04.145901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858075+0000","last_change":"2024-04-15T23:32:11.543993+0000","last_active":"2024-04-15T23:32:31.858075+0000","last_peered":"2024-04-15T23:32:31.858075+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:32:11.543993+0000","last_became_peered":"2024-04-15T23:32:11.543993+0000","last_unstale":"2024-04-15T23:32:31.858075+0000","last_undegraded":"2024-04-15T23:32:31.858075+0000","last_fullsized":"2024-04-15T23:32:11.540623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:27.827081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"14'2","reported_seq":52,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:32.788950+0000","last_change":"2024-04-15T23:32:11.547544+0000","last_active":"2024-04-15T23:32:32.788950+0000","last_peered":"2024-04-15T23:32:32.788950+0000","last_clean":"2024-04-15T23:32:07.786667+0000","last_became_active":"2024-04-15T23:32:11.547544+0000","last_became_peered":"2024-04-15T23:32:11.547544+0000","last_unstale":"2024-04-15T23:32:32.788950+0000","last_undegraded":"2024-04-15T23:32:11.543672+0000","last_fullsized":"2024-04-15T23:32:11.543587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:40.606451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858417+0000","last_change":"2024-04-15T23:32:11.543376+0000","last_active":"2024-04-15T23:32:31.858417+0000","last_peered":"2024-04-15T23:32:31.858417+0000","last_clean":"2024-04-15T23:32:07.534221+0000","last_became_active":"2024-04-15T23:32:11.543376+0000","last_became_peered":"2024-04-15T23:32:11.543376+0000","last_unstale":"2024-04-15T23:32:31.858417+0000","last_undegraded":"2024-04-15T23:32:31.858417+0000","last_fullsized":"2024-04-15T23:32:11.541450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:45:42.857925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788339+0000","last_change":"2024-04-15T23:32:11.546441+0000","last_active":"2024-04-15T23:32:32.788339+0000","last_peered":"2024-04-15T23:32:32.788339+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.546441+0000","last_became_peered":"2024-04-15T23:32:11.546441+0000","last_unstale":"2024-04-15T23:32:32.788339+0000","last_undegraded":"2024-04-15T23:32:32.788339+0000","last_fullsized":"2024-04-15T23:32:11.543536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:29.042475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789092+0000","last_change":"2024-04-15T23:32:11.546377+0000","last_active":"2024-04-15T23:32:32.789092+0000","last_peered":"2024-04-15T23:32:32.789092+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546377+0000","last_became_peered":"2024-04-15T23:32:11.546377+0000","last_unstale":"2024-04-15T23:32:32.789092+0000","last_undegraded":"2024-04-15T23:32:32.789092+0000","last_fullsized":"2024-04-15T23:32:11.543483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:22:51.206551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857507+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:32:31.857507+0000","last_peered":"2024-04-15T23:32:31.857507+0000","last_clean":"2024-04-15T23:32:31.857507+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:32:31.857507+0000","last_undegraded":"2024-04-15T23:32:31.857507+0000","last_fullsized":"2024-04-15T23:32:31.857507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789098+0000","last_change":"2024-04-15T23:32:11.547018+0000","last_active":"2024-04-15T23:32:32.789098+0000","last_peered":"2024-04-15T23:32:32.789098+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547018+0000","last_became_peered":"2024-04-15T23:32:11.547018+0000","last_unstale":"2024-04-15T23:32:32.789098+0000","last_undegraded":"2024-04-15T23:32:32.789098+0000","last_fullsized":"2024-04-15T23:32:11.543473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:46:57.018356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"14'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788355+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:32:32.788355+0000","last_peered":"2024-04-15T23:32:32.788355+0000","last_clean":"2024-04-15T23:32:32.788355+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:32:32.788355+0000","last_undegraded":"2024-04-15T23:32:32.788355+0000","last_fullsized":"2024-04-15T23:32:32.788355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789809+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:32:32.789809+0000","last_peered":"2024-04-15T23:32:32.789809+0000","last_clean":"2024-04-15T23:32:32.789809+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:32:32.789809+0000","last_undegraded":"2024-04-15T23:32:32.789809+0000","last_fullsized":"2024-04-15T23:32:32.789809+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857444+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:32:31.857444+0000","last_peered":"2024-04-15T23:32:31.857444+0000","last_clean":"2024-04-15T23:32:31.857444+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:32:31.857444+0000","last_undegraded":"2024-04-15T23:32:31.857444+0000","last_fullsized":"2024-04-15T23:32:31.857444+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"14'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858510+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:32:31.858510+0000","last_peered":"2024-04-15T23:32:31.858510+0000","last_clean":"2024-04-15T23:32:31.858510+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:32:31.858510+0000","last_undegraded":"2024-04-15T23:32:31.858510+0000","last_fullsized":"2024-04-15T23:32:31.858510+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857387+0000","last_change":"2024-04-15T23:32:03.783205+0000","last_active":"2024-04-15T23:32:31.857387+0000","last_peered":"2024-04-15T23:32:31.857387+0000","last_clean":"2024-04-15T23:32:31.857387+0000","last_became_active":"2024-04-15T23:32:03.782934+0000","last_became_peered":"2024-04-15T23:32:03.782934+0000","last_unstale":"2024-04-15T23:32:31.857387+0000","last_undegraded":"2024-04-15T23:32:31.857387+0000","last_fullsized":"2024-04-15T23:32:31.857387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:48:35.761379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789220+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:32:32.789220+0000","last_peered":"2024-04-15T23:32:32.789220+0000","last_clean":"2024-04-15T23:32:32.789220+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:32:32.789220+0000","last_undegraded":"2024-04-15T23:32:32.789220+0000","last_fullsized":"2024-04-15T23:32:32.789220+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788295+0000","last_change":"2024-04-15T23:32:11.547212+0000","last_active":"2024-04-15T23:32:32.788295+0000","last_peered":"2024-04-15T23:32:32.788295+0000","last_clean":"2024-04-15T23:32:07.786434+0000","last_became_active":"2024-04-15T23:32:11.547212+0000","last_became_peered":"2024-04-15T23:32:11.547212+0000","last_unstale":"2024-04-15T23:32:32.788295+0000","last_undegraded":"2024-04-15T23:32:32.788295+0000","last_fullsized":"2024-04-15T23:32:11.543397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:21.827833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789656+0000","last_change":"2024-04-15T23:32:11.547400+0000","last_active":"2024-04-15T23:32:32.789656+0000","last_peered":"2024-04-15T23:32:32.789656+0000","last_clean":"2024-04-15T23:32:07.786794+0000","last_became_active":"2024-04-15T23:32:11.547400+0000","last_became_peered":"2024-04-15T23:32:11.547400+0000","last_unstale":"2024-04-15T23:32:32.789656+0000","last_undegraded":"2024-04-15T23:32:32.789656+0000","last_fullsized":"2024-04-15T23:32:11.543649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:18.237296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788159+0000","last_change":"2024-04-15T23:32:11.545235+0000","last_active":"2024-04-15T23:32:32.788159+0000","last_peered":"2024-04-15T23:32:32.788159+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545235+0000","last_became_peered":"2024-04-15T23:32:11.545235+0000","last_unstale":"2024-04-15T23:32:32.788159+0000","last_undegraded":"2024-04-15T23:32:32.788159+0000","last_fullsized":"2024-04-15T23:32:11.542558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:57:44.698682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"14'2","reported_seq":32,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:32.788745+0000","last_change":"2024-04-15T23:32:11.548140+0000","last_active":"2024-04-15T23:32:32.788745+0000","last_peered":"2024-04-15T23:32:32.788745+0000","last_clean":"2024-04-15T23:31:30.873548+0000","last_became_active":"2024-04-15T23:32:11.548140+0000","last_became_peered":"2024-04-15T23:32:11.548140+0000","last_unstale":"2024-04-15T23:32:32.788745+0000","last_undegraded":"2024-04-15T23:32:11.544200+0000","last_fullsized":"2024-04-15T23:32:11.543310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:13:05.917663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788878+0000","last_change":"2024-04-15T23:32:11.545650+0000","last_active":"2024-04-15T23:32:32.788878+0000","last_peered":"2024-04-15T23:32:32.788878+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:32:11.545650+0000","last_became_peered":"2024-04-15T23:32:11.545650+0000","last_unstale":"2024-04-15T23:32:32.788878+0000","last_undegraded":"2024-04-15T23:32:32.788878+0000","last_fullsized":"2024-04-15T23:32:11.543190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:45:42.857925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788529+0000","last_change":"2024-04-15T23:32:11.548343+0000","last_active":"2024-04-15T23:32:32.788529+0000","last_peered":"2024-04-15T23:32:32.788529+0000","last_clean":"2024-04-15T23:32:07.786600+0000","last_became_active":"2024-04-15T23:32:11.548343+0000","last_became_peered":"2024-04-15T23:32:11.548343+0000","last_unstale":"2024-04-15T23:32:32.788529+0000","last_undegraded":"2024-04-15T23:32:32.788529+0000","last_fullsized":"2024-04-15T23:32:11.544334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:17:01.902464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789136+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:32:32.789136+0000","last_peered":"2024-04-15T23:32:32.789136+0000","last_clean":"2024-04-15T23:32:32.789136+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:32:32.789136+0000","last_undegraded":"2024-04-15T23:32:32.789136+0000","last_fullsized":"2024-04-15T23:32:32.789136+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857564+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:32:31.857564+0000","last_peered":"2024-04-15T23:32:31.857564+0000","last_clean":"2024-04-15T23:32:31.857564+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:32:31.857564+0000","last_undegraded":"2024-04-15T23:32:31.857564+0000","last_fullsized":"2024-04-15T23:32:31.857564+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789741+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:32:32.789741+0000","last_peered":"2024-04-15T23:32:32.789741+0000","last_clean":"2024-04-15T23:32:32.789741+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:32:32.789741+0000","last_undegraded":"2024-04-15T23:32:32.789741+0000","last_fullsized":"2024-04-15T23:32:32.789741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857938+0000","last_change":"2024-04-15T23:32:11.542193+0000","last_active":"2024-04-15T23:32:31.857938+0000","last_peered":"2024-04-15T23:32:31.857938+0000","last_clean":"2024-04-15T23:32:07.533690+0000","last_became_active":"2024-04-15T23:32:11.542193+0000","last_became_peered":"2024-04-15T23:32:11.542193+0000","last_unstale":"2024-04-15T23:32:31.857938+0000","last_undegraded":"2024-04-15T23:32:31.857938+0000","last_fullsized":"2024-04-15T23:32:11.539806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:17:23.122806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858229+0000","last_change":"2024-04-15T23:32:11.543916+0000","last_active":"2024-04-15T23:32:31.858229+0000","last_peered":"2024-04-15T23:32:31.858229+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543916+0000","last_became_peered":"2024-04-15T23:32:11.543916+0000","last_unstale":"2024-04-15T23:32:31.858229+0000","last_undegraded":"2024-04-15T23:32:31.858229+0000","last_fullsized":"2024-04-15T23:32:11.540434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:24:53.954892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":250,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788538+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:32:32.788538+0000","last_peered":"2024-04-15T23:32:32.788538+0000","last_clean":"2024-04-15T23:32:32.788538+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:32:32.788538+0000","last_undegraded":"2024-04-15T23:32:32.788538+0000","last_fullsized":"2024-04-15T23:32:32.788538+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789169+0000","last_change":"2024-04-15T23:32:11.548922+0000","last_active":"2024-04-15T23:32:32.789169+0000","last_peered":"2024-04-15T23:32:32.789169+0000","last_clean":"2024-04-15T23:32:07.786775+0000","last_became_active":"2024-04-15T23:32:11.548922+0000","last_became_peered":"2024-04-15T23:32:11.548922+0000","last_unstale":"2024-04-15T23:32:32.789169+0000","last_undegraded":"2024-04-15T23:32:32.789169+0000","last_fullsized":"2024-04-15T23:32:11.544390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:42:25.823499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857511+0000","last_change":"2024-04-15T23:32:11.542325+0000","last_active":"2024-04-15T23:32:31.857511+0000","last_peered":"2024-04-15T23:32:31.857511+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.542325+0000","last_became_peered":"2024-04-15T23:32:11.542325+0000","last_unstale":"2024-04-15T23:32:31.857511+0000","last_undegraded":"2024-04-15T23:32:31.857511+0000","last_fullsized":"2024-04-15T23:32:11.539842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:52:49.431439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789170+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:32:32.789170+0000","last_peered":"2024-04-15T23:32:32.789170+0000","last_clean":"2024-04-15T23:32:32.789170+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:32:32.789170+0000","last_undegraded":"2024-04-15T23:32:32.789170+0000","last_fullsized":"2024-04-15T23:32:32.789170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788467+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:32:32.788467+0000","last_peered":"2024-04-15T23:32:32.788467+0000","last_clean":"2024-04-15T23:32:32.788467+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:32:32.788467+0000","last_undegraded":"2024-04-15T23:32:32.788467+0000","last_fullsized":"2024-04-15T23:32:32.788467+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788204+0000","last_change":"2024-04-15T23:32:11.545347+0000","last_active":"2024-04-15T23:32:32.788204+0000","last_peered":"2024-04-15T23:32:32.788204+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545347+0000","last_became_peered":"2024-04-15T23:32:11.545347+0000","last_unstale":"2024-04-15T23:32:32.788204+0000","last_undegraded":"2024-04-15T23:32:32.788204+0000","last_fullsized":"2024-04-15T23:32:11.542681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:44:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858127+0000","last_change":"2024-04-15T23:32:11.543852+0000","last_active":"2024-04-15T23:32:31.858127+0000","last_peered":"2024-04-15T23:32:31.858127+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:32:11.543852+0000","last_became_peered":"2024-04-15T23:32:11.543852+0000","last_unstale":"2024-04-15T23:32:31.858127+0000","last_undegraded":"2024-04-15T23:32:31.858127+0000","last_fullsized":"2024-04-15T23:32:11.541322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:17.236231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857657+0000","last_change":"2024-04-15T23:32:11.542965+0000","last_active":"2024-04-15T23:32:31.857657+0000","last_peered":"2024-04-15T23:32:31.857657+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.542965+0000","last_became_peered":"2024-04-15T23:32:11.542965+0000","last_unstale":"2024-04-15T23:32:31.857657+0000","last_undegraded":"2024-04-15T23:32:31.857657+0000","last_fullsized":"2024-04-15T23:32:11.540072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:57:39.420721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858095+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:32:31.858095+0000","last_peered":"2024-04-15T23:32:31.858095+0000","last_clean":"2024-04-15T23:32:31.858095+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:32:31.858095+0000","last_undegraded":"2024-04-15T23:32:31.858095+0000","last_fullsized":"2024-04-15T23:32:31.858095+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857752+0000","last_change":"2024-04-15T23:32:11.543464+0000","last_active":"2024-04-15T23:32:31.857752+0000","last_peered":"2024-04-15T23:32:31.857752+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543464+0000","last_became_peered":"2024-04-15T23:32:11.543464+0000","last_unstale":"2024-04-15T23:32:31.857752+0000","last_undegraded":"2024-04-15T23:32:31.857752+0000","last_fullsized":"2024-04-15T23:32:11.540108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:53:35.957069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788672+0000","last_change":"2024-04-15T23:32:11.548935+0000","last_active":"2024-04-15T23:32:32.788672+0000","last_peered":"2024-04-15T23:32:32.788672+0000","last_clean":"2024-04-15T23:32:07.786618+0000","last_became_active":"2024-04-15T23:32:11.548935+0000","last_became_peered":"2024-04-15T23:32:11.548935+0000","last_unstale":"2024-04-15T23:32:32.788672+0000","last_undegraded":"2024-04-15T23:32:32.788672+0000","last_fullsized":"2024-04-15T23:32:11.544475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:10:22.696167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789008+0000","last_change":"2024-04-15T23:32:11.548361+0000","last_active":"2024-04-15T23:32:32.789008+0000","last_peered":"2024-04-15T23:32:32.789008+0000","last_clean":"2024-04-15T23:32:07.786748+0000","last_became_active":"2024-04-15T23:32:11.548361+0000","last_became_peered":"2024-04-15T23:32:11.548361+0000","last_unstale":"2024-04-15T23:32:32.789008+0000","last_undegraded":"2024-04-15T23:32:32.789008+0000","last_fullsized":"2024-04-15T23:32:11.544250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:14:20.393048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857773+0000","last_change":"2024-04-15T23:32:11.542992+0000","last_active":"2024-04-15T23:32:31.857773+0000","last_peered":"2024-04-15T23:32:31.857773+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542992+0000","last_became_peered":"2024-04-15T23:32:11.542992+0000","last_unstale":"2024-04-15T23:32:31.857773+0000","last_undegraded":"2024-04-15T23:32:31.857773+0000","last_fullsized":"2024-04-15T23:32:11.540105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:11.877760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789302+0000","last_change":"2024-04-15T23:32:11.546308+0000","last_active":"2024-04-15T23:32:32.789302+0000","last_peered":"2024-04-15T23:32:32.789302+0000","last_clean":"2024-04-15T23:32:07.786926+0000","last_became_active":"2024-04-15T23:32:11.546308+0000","last_became_peered":"2024-04-15T23:32:11.546308+0000","last_unstale":"2024-04-15T23:32:32.789302+0000","last_undegraded":"2024-04-15T23:32:32.789302+0000","last_fullsized":"2024-04-15T23:32:11.543424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:54:54.358011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858483+0000","last_change":"2024-04-15T23:32:11.544222+0000","last_active":"2024-04-15T23:32:31.858483+0000","last_peered":"2024-04-15T23:32:31.858483+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.544222+0000","last_became_peered":"2024-04-15T23:32:11.544222+0000","last_unstale":"2024-04-15T23:32:31.858483+0000","last_undegraded":"2024-04-15T23:32:31.858483+0000","last_fullsized":"2024-04-15T23:32:11.540903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:36.399440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857725+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:32:31.857725+0000","last_peered":"2024-04-15T23:32:31.857725+0000","last_clean":"2024-04-15T23:32:31.857725+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:32:31.857725+0000","last_undegraded":"2024-04-15T23:32:31.857725+0000","last_fullsized":"2024-04-15T23:32:31.857725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857857+0000","last_change":"2024-04-15T23:32:11.543668+0000","last_active":"2024-04-15T23:32:31.857857+0000","last_peered":"2024-04-15T23:32:31.857857+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.543668+0000","last_became_peered":"2024-04-15T23:32:11.543668+0000","last_unstale":"2024-04-15T23:32:31.857857+0000","last_undegraded":"2024-04-15T23:32:31.857857+0000","last_fullsized":"2024-04-15T23:32:11.540356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:33.896469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858873+0000","last_change":"2024-04-15T23:32:11.546268+0000","last_active":"2024-04-15T23:32:31.858873+0000","last_peered":"2024-04-15T23:32:31.858873+0000","last_clean":"2024-04-15T23:32:07.534420+0000","last_became_active":"2024-04-15T23:32:11.546268+0000","last_became_peered":"2024-04-15T23:32:11.546268+0000","last_unstale":"2024-04-15T23:32:31.858873+0000","last_undegraded":"2024-04-15T23:32:31.858873+0000","last_fullsized":"2024-04-15T23:32:11.542494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:49:13.964566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857881+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:32:31.857881+0000","last_peered":"2024-04-15T23:32:31.857881+0000","last_clean":"2024-04-15T23:32:31.857881+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:32:31.857881+0000","last_undegraded":"2024-04-15T23:32:31.857881+0000","last_fullsized":"2024-04-15T23:32:31.857881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":32,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:31.858511+0000","last_change":"2024-04-15T23:32:11.546222+0000","last_active":"2024-04-15T23:32:31.858511+0000","last_peered":"2024-04-15T23:32:31.858511+0000","last_clean":"2024-04-15T23:31:30.875670+0000","last_became_active":"2024-04-15T23:32:11.546222+0000","last_became_peered":"2024-04-15T23:32:11.546222+0000","last_unstale":"2024-04-15T23:32:31.858511+0000","last_undegraded":"2024-04-15T23:32:11.541817+0000","last_fullsized":"2024-04-15T23:32:11.540942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:24:19.706517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858604+0000","last_change":"2024-04-15T23:32:11.546473+0000","last_active":"2024-04-15T23:32:31.858604+0000","last_peered":"2024-04-15T23:32:31.858604+0000","last_clean":"2024-04-15T23:31:24.576473+0000","last_became_active":"2024-04-15T23:32:11.546473+0000","last_became_peered":"2024-04-15T23:32:11.546473+0000","last_unstale":"2024-04-15T23:32:31.858604+0000","last_undegraded":"2024-04-15T23:32:31.858604+0000","last_fullsized":"2024-04-15T23:32:11.541882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:07.371350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.787972+0000","last_change":"2024-04-15T23:32:11.544726+0000","last_active":"2024-04-15T23:32:32.787972+0000","last_peered":"2024-04-15T23:32:32.787972+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544726+0000","last_became_peered":"2024-04-15T23:32:11.544726+0000","last_unstale":"2024-04-15T23:32:32.787972+0000","last_undegraded":"2024-04-15T23:32:32.787972+0000","last_fullsized":"2024-04-15T23:32:11.542306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:11.877760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"18'3","reported_seq":43,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:32.789222+0000","last_change":"2024-04-15T23:32:11.547480+0000","last_active":"2024-04-15T23:32:32.789222+0000","last_peered":"2024-04-15T23:32:32.789222+0000","last_clean":"2024-04-15T23:31:56.677189+0000","last_became_active":"2024-04-15T23:32:11.547480+0000","last_became_peered":"2024-04-15T23:32:11.547480+0000","last_unstale":"2024-04-15T23:32:32.789222+0000","last_undegraded":"2024-04-15T23:32:11.543622+0000","last_fullsized":"2024-04-15T23:32:11.543547+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:11.644081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789832+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:32:32.789832+0000","last_peered":"2024-04-15T23:32:32.789832+0000","last_clean":"2024-04-15T23:32:32.789832+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:32:32.789832+0000","last_undegraded":"2024-04-15T23:32:32.789832+0000","last_fullsized":"2024-04-15T23:32:32.789832+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.857480+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:32:31.857480+0000","last_peered":"2024-04-15T23:32:31.857480+0000","last_clean":"2024-04-15T23:32:31.857480+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:32:31.857480+0000","last_undegraded":"2024-04-15T23:32:31.857480+0000","last_fullsized":"2024-04-15T23:32:31.857480+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.788653+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:32:32.788653+0000","last_peered":"2024-04-15T23:32:32.788653+0000","last_clean":"2024-04-15T23:32:32.788653+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:32:32.788653+0000","last_undegraded":"2024-04-15T23:32:32.788653+0000","last_fullsized":"2024-04-15T23:32:32.788653+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:32.789624+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:32:32.789624+0000","last_peered":"2024-04-15T23:32:32.789624+0000","last_clean":"2024-04-15T23:32:32.789624+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:32:32.789624+0000","last_undegraded":"2024-04-15T23:32:32.789624+0000","last_fullsized":"2024-04-15T23:32:32.789624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6553,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857406+0000","last_change":"2024-04-15T23:32:11.542068+0000","last_active":"2024-04-15T23:32:31.857406+0000","last_peered":"2024-04-15T23:32:31.857406+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542068+0000","last_became_peered":"2024-04-15T23:32:11.542068+0000","last_unstale":"2024-04-15T23:32:31.857406+0000","last_undegraded":"2024-04-15T23:32:31.857406+0000","last_fullsized":"2024-04-15T23:32:11.539597+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:16:50.754369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"14'3","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858811+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:32:31.858811+0000","last_peered":"2024-04-15T23:32:31.858811+0000","last_clean":"2024-04-15T23:32:31.858811+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:32:31.858811+0000","last_undegraded":"2024-04-15T23:32:31.858811+0000","last_fullsized":"2024-04-15T23:32:31.858811+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789827+0000","last_change":"2024-04-15T23:32:11.548236+0000","last_active":"2024-04-15T23:32:32.789827+0000","last_peered":"2024-04-15T23:32:32.789827+0000","last_clean":"2024-04-15T23:32:07.787053+0000","last_became_active":"2024-04-15T23:32:11.548236+0000","last_became_peered":"2024-04-15T23:32:11.548236+0000","last_unstale":"2024-04-15T23:32:32.789827+0000","last_undegraded":"2024-04-15T23:32:32.789827+0000","last_fullsized":"2024-04-15T23:32:11.544657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:31:01.188666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788025+0000","last_change":"2024-04-15T23:32:11.544436+0000","last_active":"2024-04-15T23:32:32.788025+0000","last_peered":"2024-04-15T23:32:32.788025+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544436+0000","last_became_peered":"2024-04-15T23:32:11.544436+0000","last_unstale":"2024-04-15T23:32:32.788025+0000","last_undegraded":"2024-04-15T23:32:32.788025+0000","last_fullsized":"2024-04-15T23:32:11.542388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:52:50.436669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789275+0000","last_change":"2024-04-15T23:32:11.546257+0000","last_active":"2024-04-15T23:32:32.789275+0000","last_peered":"2024-04-15T23:32:32.789275+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.546257+0000","last_became_peered":"2024-04-15T23:32:11.546257+0000","last_unstale":"2024-04-15T23:32:32.789275+0000","last_undegraded":"2024-04-15T23:32:32.789275+0000","last_fullsized":"2024-04-15T23:32:11.543657+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:17.519004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857266+0000","last_change":"2024-04-15T23:32:11.540897+0000","last_active":"2024-04-15T23:32:31.857266+0000","last_peered":"2024-04-15T23:32:31.857266+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.540897+0000","last_became_peered":"2024-04-15T23:32:11.540897+0000","last_unstale":"2024-04-15T23:32:31.857266+0000","last_undegraded":"2024-04-15T23:32:31.857266+0000","last_fullsized":"2024-04-15T23:32:11.539469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:39:20.518476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858684+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:32:31.858684+0000","last_peered":"2024-04-15T23:32:31.858684+0000","last_clean":"2024-04-15T23:32:31.858684+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:32:31.858684+0000","last_undegraded":"2024-04-15T23:32:31.858684+0000","last_fullsized":"2024-04-15T23:32:31.858684+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858240+0000","last_change":"2024-04-15T23:32:11.543133+0000","last_active":"2024-04-15T23:32:31.858240+0000","last_peered":"2024-04-15T23:32:31.858240+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.543133+0000","last_became_peered":"2024-04-15T23:32:11.543133+0000","last_unstale":"2024-04-15T23:32:31.858240+0000","last_undegraded":"2024-04-15T23:32:31.858240+0000","last_fullsized":"2024-04-15T23:32:11.540630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:02:00.931096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.789271+0000","last_change":"2024-04-15T23:32:11.547180+0000","last_active":"2024-04-15T23:32:32.789271+0000","last_peered":"2024-04-15T23:32:32.789271+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:32:32.789271+0000","last_undegraded":"2024-04-15T23:32:32.789271+0000","last_fullsized":"2024-04-15T23:32:11.544284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:24:20.711747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788422+0000","last_change":"2024-04-15T23:32:11.545332+0000","last_active":"2024-04-15T23:32:32.788422+0000","last_peered":"2024-04-15T23:32:32.788422+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545332+0000","last_became_peered":"2024-04-15T23:32:11.545332+0000","last_unstale":"2024-04-15T23:32:32.788422+0000","last_undegraded":"2024-04-15T23:32:32.788422+0000","last_fullsized":"2024-04-15T23:32:11.542751+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:17:29.563001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858326+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:32:31.858326+0000","last_peered":"2024-04-15T23:32:31.858326+0000","last_clean":"2024-04-15T23:32:31.858326+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:32:31.858326+0000","last_undegraded":"2024-04-15T23:32:31.858326+0000","last_fullsized":"2024-04-15T23:32:31.858326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"14'1","reported_seq":51,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857943+0000","last_change":"2024-04-15T23:32:11.543424+0000","last_active":"2024-04-15T23:32:31.857943+0000","last_peered":"2024-04-15T23:32:31.857943+0000","last_clean":"2024-04-15T23:32:07.533959+0000","last_became_active":"2024-04-15T23:32:11.543424+0000","last_became_peered":"2024-04-15T23:32:11.543424+0000","last_unstale":"2024-04-15T23:32:31.857943+0000","last_undegraded":"2024-04-15T23:32:31.857943+0000","last_fullsized":"2024-04-15T23:32:11.540315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:44:11.004444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858011+0000","last_change":"2024-04-15T23:32:11.543802+0000","last_active":"2024-04-15T23:32:31.858011+0000","last_peered":"2024-04-15T23:32:31.858011+0000","last_clean":"2024-04-15T23:32:07.533902+0000","last_became_active":"2024-04-15T23:32:11.543802+0000","last_became_peered":"2024-04-15T23:32:11.543802+0000","last_unstale":"2024-04-15T23:32:31.858011+0000","last_undegraded":"2024-04-15T23:32:31.858011+0000","last_fullsized":"2024-04-15T23:32:11.540623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:10:04.145901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"14'1","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858041+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:32:31.858041+0000","last_peered":"2024-04-15T23:32:31.858041+0000","last_clean":"2024-04-15T23:32:31.858041+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:32:31.858041+0000","last_undegraded":"2024-04-15T23:32:31.858041+0000","last_fullsized":"2024-04-15T23:32:31.858041+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788618+0000","last_change":"2024-04-15T23:32:11.545464+0000","last_active":"2024-04-15T23:32:32.788618+0000","last_peered":"2024-04-15T23:32:32.788618+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:32:11.545464+0000","last_became_peered":"2024-04-15T23:32:11.545464+0000","last_unstale":"2024-04-15T23:32:32.788618+0000","last_undegraded":"2024-04-15T23:32:32.788618+0000","last_fullsized":"2024-04-15T23:32:11.542953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:49:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":52,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:32.789113+0000","last_change":"2024-04-15T23:32:11.547001+0000","last_active":"2024-04-15T23:32:32.789113+0000","last_peered":"2024-04-15T23:32:32.789113+0000","last_clean":"2024-04-15T23:32:07.786711+0000","last_became_active":"2024-04-15T23:32:11.547001+0000","last_became_peered":"2024-04-15T23:32:11.547001+0000","last_unstale":"2024-04-15T23:32:32.789113+0000","last_undegraded":"2024-04-15T23:32:11.543553+0000","last_fullsized":"2024-04-15T23:32:11.543469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:04:01.920070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788491+0000","last_change":"2024-04-15T23:32:11.547235+0000","last_active":"2024-04-15T23:32:32.788491+0000","last_peered":"2024-04-15T23:32:32.788491+0000","last_clean":"2024-04-15T23:32:07.786529+0000","last_became_active":"2024-04-15T23:32:11.547235+0000","last_became_peered":"2024-04-15T23:32:11.547235+0000","last_unstale":"2024-04-15T23:32:32.788491+0000","last_undegraded":"2024-04-15T23:32:32.788491+0000","last_fullsized":"2024-04-15T23:32:11.544228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:51:42.570150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"14'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-15T23:32:31.858694+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:32:31.858694+0000","last_peered":"2024-04-15T23:32:31.858694+0000","last_clean":"2024-04-15T23:32:31.858694+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:32:31.858694+0000","last_undegraded":"2024-04-15T23:32:31.858694+0000","last_fullsized":"2024-04-15T23:32:31.858694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.857607+0000","last_change":"2024-04-15T23:32:11.543217+0000","last_active":"2024-04-15T23:32:31.857607+0000","last_peered":"2024-04-15T23:32:31.857607+0000","last_clean":"2024-04-15T23:32:07.533827+0000","last_became_active":"2024-04-15T23:32:11.543217+0000","last_became_peered":"2024-04-15T23:32:11.543217+0000","last_unstale":"2024-04-15T23:32:31.857607+0000","last_undegraded":"2024-04-15T23:32:31.857607+0000","last_fullsized":"2024-04-15T23:32:11.539906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:27:36.430263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"14'1","reported_seq":22,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:31.858284+0000","last_change":"2024-04-15T23:32:11.545980+0000","last_active":"2024-04-15T23:32:31.858284+0000","last_peered":"2024-04-15T23:32:31.858284+0000","last_clean":"2024-04-15T23:31:28.849203+0000","last_became_active":"2024-04-15T23:32:11.545980+0000","last_became_peered":"2024-04-15T23:32:11.545980+0000","last_unstale":"2024-04-15T23:32:31.858284+0000","last_undegraded":"2024-04-15T23:32:31.858284+0000","last_fullsized":"2024-04-15T23:32:11.541496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:04:01.920070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+undersized","last_fresh":"2024-04-15T23:32:32.788410+0000","last_change":"2024-04-15T23:32:11.548138+0000","last_active":"2024-04-15T23:32:32.788410+0000","last_peered":"2024-04-15T23:32:32.788410+0000","last_clean":"2024-04-15T23:32:07.786282+0000","last_became_active":"2024-04-15T23:32:11.548138+0000","last_became_peered":"2024-04-15T23:32:11.548138+0000","last_unstale":"2024-04-15T23:32:32.788410+0000","last_undegraded":"2024-04-15T23:32:32.788410+0000","last_fullsized":"2024-04-15T23:32:11.544570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:48:06.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"14'4","reported_seq":32,"reported_epoch":32,"state":"active+undersized+degraded","last_fresh":"2024-04-15T23:32:32.789610+0000","last_change":"2024-04-15T23:32:11.547071+0000","last_active":"2024-04-15T23:32:32.789610+0000","last_peered":"2024-04-15T23:32:32.789610+0000","last_clean":"2024-04-15T23:31:30.875139+0000","last_became_active":"2024-04-15T23:32:11.547071+0000","last_became_peered":"2024-04-15T23:32:11.547071+0000","last_unstale":"2024-04-15T23:32:32.789610+0000","last_undegraded":"2024-04-15T23:32:11.544177+0000","last_fullsized":"2024-04-15T23:32:11.543927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:19:26.821850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7351,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":43,"acting":43,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35540,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336300,"statfs":{"total":96636764160,"available":96600371200,"internally_reserved":0,"allocated":204800,"data_stored":80548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":901120,"data_stored":717385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738384,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":892928,"data_stored":716769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:32:38.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-backfill 3.7 3.1f 2024-04-15T23:32:38.130 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:38.148+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:38.170 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.170 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:38.232 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:38.249+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:38.287 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.288 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:38.333 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:38.350+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:38.406 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.407 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.415 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:38.459 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:38.476+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:38.490 INFO:teuthology.orchestra.run.smithi102.stderr:instructing pg(s) [3.7] on osd.0 to force-backfill; instructing pg(s) [3.1f] on osd.1 to force-backfill; 2024-04-15T23:32:38.490 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-15T23:32:38.524 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.524 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.533 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:38.574 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:38.591+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:38.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2024-04-15T23:32:38.635 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:38.652+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:38.682 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.682 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:38.736 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:38.752+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:38.802 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.802 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.810 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:38.852 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:38.869+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:38.938 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:38.955+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:38.940 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:38.959 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:38.959 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:38.968 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:39.038 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:39.055+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:39.077 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:39.077 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:39.078 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.023241455000004, 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:39.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.022548911000001, 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.022156996999996, 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.021822552000003, 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.020527199, 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.668261336, 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.668038334000002, 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.667597490999995, 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:39.109 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:39.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.666945534000007, 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:39.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:39.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.666139267000005, 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.664038773000001, 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:39.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:39.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.127 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226574694999996, 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:39.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:39.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226517951000005, 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:39.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:39.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:39.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226406795000003, 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:39.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:39.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:39.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226319781000001, 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:39.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226286079999994, 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:39.150 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226097541000001, 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226053323000002, 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.166 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.226012823999994, 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.225971114000004, 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:39.174 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:39.175 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:39.176 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:39.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:39.177 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:39.192+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:39.178 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:39.178 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:39.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:39.276 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:39.293+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:39.287 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:39.288 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:39.288 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:39.288 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:39.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:39.377 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:39.393+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:39.403 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:39.403 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:39.403 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:39.403 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:39.403 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:39.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:39.496 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:39.513+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:39.562 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:39.562 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:39.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:39.562 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:39.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.562 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.508220144999996, 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.508138657000003, 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.568 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:39.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:39.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:39.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.573 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.710046965999993, 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.578 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709998975999994, 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:39.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709960676999998, 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.584 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:39.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:39.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:39.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:39.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709921889, 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:39.589 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.594 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709898558000006, 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:39.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:39.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:39.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709868072999996, 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709833004000004, 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:39.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.609 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709809261000004, 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:39.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:39.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:39.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:39.614 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709785002000004, 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:39.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709756662999993, 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709717863999998, 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:39.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.631 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709682693000005, 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:39.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:39.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:39.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.636 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709649325000001, 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.641 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.709591864000004, 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:39.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:39.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:39.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.646 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.707956203999998, 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:39.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:39.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:39.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:39.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:39.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.707064672000001, 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.707013324000002, 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 68.706975208000003, 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:39.662 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.665 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.666 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.666 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:39.666 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:39.666 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:39.667 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:39.668 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:39.684+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:39.768 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:39.785+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:39.778 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:39.778 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:39.778 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:39.787 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:39.869 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:32:39.870 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:39.886+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:39.934 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:39.934 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:39.935 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:39.935 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:39.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:39.971 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:39.987+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.997462795999994, 2024-04-15T23:32:40.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.996770252000005, 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.996378338, 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:40.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:40.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:40.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:40.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.996043893000007, 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:40.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:40.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.994748540000003, 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:40.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:40.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.642482677000004, 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.076 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:40.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:40.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:40.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.642259675000005, 2024-04-15T23:32:40.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:40.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:40.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.641818831999998, 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.641166874999996, 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:40.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:40.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.640360607999995, 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:40.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:40.097 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.638260114000005, 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:40.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200796036, 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200739291999994, 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:40.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:40.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:40.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:40.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:40.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200628136000006, 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200541122000004, 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:40.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:40.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:40.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:40.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200507420999998, 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:40.122 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:40.127 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200318882000005, 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:40.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:40.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.132 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200274664000005, 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200234164999998, 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.141 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.200192455000007, 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:40.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:40.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:40.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:40.145 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:40.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:40.147 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:40.163+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:40.248 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:40.264+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:40.258 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:40.258 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:40.259 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:40.259 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:40.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:40.349 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:40.366+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:40.416 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:40.417 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:40.417 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:40.417 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:40.417 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:40.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:40.450 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:40.467+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:40.535 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:40.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.481523124000006, 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.536 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:40.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:40.541 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.481441636, 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:40.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683349945000003, 2024-04-15T23:32:40.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:40.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:40.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.554 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683301955000005, 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:40.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:40.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:40.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683263655999994, 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.560 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:40.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:40.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683224867999996, 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:40.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683201537000002, 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.571 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:40.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683171052000006, 2024-04-15T23:32:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:40.577 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:40.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:40.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683135983, 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:40.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:40.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.593 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.68311224, 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.594 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:40.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:40.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:40.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.602 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683087981, 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:40.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:40.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:40.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683059642000003, 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.611 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:40.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:40.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:40.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.683020842999994, 2024-04-15T23:32:40.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:40.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:40.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:40.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.682985672000001, 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.628 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:40.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:40.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:40.634 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.635 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:40.636 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.682952303999997, 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:40.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.638 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:40.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:40.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.682894843, 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.645 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:40.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:40.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.681259182999995, 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:40.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:40.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:40.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:40.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:40.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.680367650999997, 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.680316302999998, 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:40.664 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 69.680278186999999, 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:40.669 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:40.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:40.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:40.672 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.673 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.673 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.673 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:40.673 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:40.673 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:40.674 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:40.690+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:40.675 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:40.775 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:40.792+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:40.790 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:40.790 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:40.791 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:40.799 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:40.871 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:32:40.885 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:40.903+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:40.948 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:40.948 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:40.948 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:40.957 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:40.998 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:41.015+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:41.078 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.094+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.052193611000007, 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:41.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.051501067000004, 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:41.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:41.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.116 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.051109152999999, 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:41.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:41.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:41.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.050774708000006, 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:41.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.049479355000003, 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:41.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:41.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:41.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.697213492000003, 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:41.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:41.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:41.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:41.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.696990490000005, 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:41.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:41.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.696549646999998, 2024-04-15T23:32:41.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:41.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:41.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.695897689999995, 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.695091422999994, 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:41.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:41.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:41.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.692990929000004, 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:41.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:41.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:41.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255526850999999, 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.160 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255470106999994, 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:41.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255358951000005, 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:41.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:41.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:41.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255271937000003, 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:41.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255238235999997, 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:41.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255049697000004, 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:41.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:41.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.189 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.255005479000005, 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:41.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:41.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.197 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.254964979999997, 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 70.254923270000006, 2024-04-15T23:32:41.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:41.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:41.205 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:41.206 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:41.208 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.223+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:41.307 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.323+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.320 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:41.320 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:41.320 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:41.320 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:41.329 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:41.336 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:41.355 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:41.355 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:41.355 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:41.358 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:41.359 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:41.413 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.429+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.477 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:41.478 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:41.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:41.527 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.543+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.610 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.626+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.633 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:41.633 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:41.642 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:41.711 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:41.727+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:41.759 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:41.760 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:41.769 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:41.812 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:41.828+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:41.913 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:41.930+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:41.918 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:41.918 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:41.928 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:42.014 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:42.031+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:42.077 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.077 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:42.116 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:42.133+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:42.195 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.196 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:42.247 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:42.263+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:42.311 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.311 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.318 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:42.335+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:42.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:42.418 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:42.434+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:42.468 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.468 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:42.519 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:42.535+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:42.587 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.587 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.596 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:42.640 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:42.657+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:42.703 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.703 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:42.753 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:42.770+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:42.820 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:42.838+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:42.861 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.861 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:42.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:32:42.921 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:42.939+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:42.978 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:42.978 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:42.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:43.032 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:43.048+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:43.098 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:43.098 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:43.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:43.148 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:43.164+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:43.225 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:43.242+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:43.256 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:43.256 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:43.264 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:43.326 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:43.343+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:43.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:43.373 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:43.374 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:43.382 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:43.427 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:43.442+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:43.489 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:43.490 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:43.490 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:43.490 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:43.490 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:43.490 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:43.490 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:43.500 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:43.505 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:43.505 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:43.505 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-15T23:32:43.505 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-15T23:32:43.505 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-15T23:32:43.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-15T23:32:43.508 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:43.509 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:43.509 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:43.512 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:43.513 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:43.545 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:43.561+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:43.612 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.556905724000003, 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.617 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.55621318, 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:43.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:43.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:43.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.555821265999995, 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.622 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:43.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.555486821000002, 2024-04-15T23:32:43.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.554191467999999, 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.631 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:43.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:43.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:43.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.201925605, 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.635 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.201702603000001, 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:43.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.201261759999994, 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.644 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:43.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:43.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:43.648 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.200609803000006, 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:43.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:43.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.652 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.653 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.199803536000005, 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.657 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.197703042000001, 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.760238963999996, 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:43.662 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:43.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:43.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:43.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.667 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.760182220000004, 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:43.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:43.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:43.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.760071064000002, 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:43.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:43.678 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.75998405, 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:43.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:43.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.759950348999993, 2024-04-15T23:32:43.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:43.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.759761810000001, 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.759717592000001, 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:43.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:43.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:43.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:43.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.759677092999993, 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:43.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 72.759635383000003, 2024-04-15T23:32:43.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:43.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:43.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:43.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:43.709 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:43.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:43.712 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:43.712 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-15T23:32:43.712 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:43.713 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:43.727+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:43.812 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:43.828+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:43.823 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:43.823 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:43.823 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:43.823 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:43.834 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:43.877 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:32:43.912 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:43.928+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:43.944 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:43.944 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:43.944 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:43.953 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:44.037 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:44.053+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:44.104 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:44.104 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:44.104 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.050420920999997, 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:44.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.106 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.107 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.108 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.109 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.110 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.050339433000005, 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:44.111 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.112 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.112 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.112 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.112 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.113 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.114 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.115 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.116 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.117 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252247741999994, 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.118 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.119 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.120 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.121 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.122 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.123 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252199751999996, 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.124 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.125 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.126 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.127 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.128 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252161452999999, 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.129 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:44.130 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.131 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:44.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:44.133 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252122665000002, 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.134 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.135 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.136 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.138 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252099333999993, 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.139 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:44.141 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:44.142 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:44.143 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.144 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252068848999997, 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.145 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:44.146 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:44.147 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:44.148 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:44.149 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252033780000005, 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.150 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.151 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.152 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.153 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.154 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.252010037000005, 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.155 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:44.156 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.157 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:44.158 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:44.159 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.251985778000005, 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.160 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.161 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.162 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.163 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.164 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.165 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.251957438999995, 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.166 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.167 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.168 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.170 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.25191864, 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:44.171 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:44.172 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:44.173 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:44.174 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:44.175 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.251883469000006, 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.176 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.177 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.178 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.179 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.180 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.251850101000002, 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.181 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.182 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.183 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.251792640000005, 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.186 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:44.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:44.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:44.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.25015698, 2024-04-15T23:32:44.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.249265448000003, 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:44.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:44.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:44.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:44.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.201 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.249214100000003, 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:44.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 73.249175984000004, 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:44.210 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:44.212 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:44.213 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:44.228+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:44.312 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:44.329+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:44.324 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:44.325 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:44.325 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:44.325 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:44.334 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:44.418 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:44.435+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:44.483 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:44.483 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:44.483 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:44.484 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:44.484 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:44.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:44.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-04-15T23:32:44.514 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:44.531+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:44.615 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:44.631+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:44.642 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:44.642 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:44.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:44.642 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:44.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.586470555999995, 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.585778012000006, 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:44.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:44.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.585386098000001, 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:44.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:44.658 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.585051652999994, 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:44.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.583756300000005, 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:44.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:44.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:44.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.231490437000005, 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.669 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:44.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:44.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.231267435000007, 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:44.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:44.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:44.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.230826592, 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:44.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:44.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:44.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.230174634999997, 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:44.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:44.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:44.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.229368367999996, 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:44.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.227267874000006, 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:44.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789803796000001, 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:44.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789747051999996, 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:44.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:44.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:44.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:44.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.714 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789635895999993, 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:44.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:44.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789548882000005, 2024-04-15T23:32:44.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:44.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:44.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789515180999999, 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789326642000006, 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:44.734 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:44.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:44.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:44.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.740 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789282424000007, 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:44.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789241924999999, 2024-04-15T23:32:44.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:44.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:44.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:44.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.789200214999994, 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:44.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:44.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:44.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:44.757 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:44.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:44.759 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:44.775+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:44.860 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:44.875+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:44.872 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:44.873 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:44.873 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:44.873 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:44.881 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:44.965 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:44.981+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:45.029 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:45.029 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:45.030 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:45.030 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:45.038 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:45.061 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:45.078+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:45.162 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:45.178+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:45.189 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:45.189 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:45.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.135532175999998, 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:45.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:45.193 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:45.194 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.195 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 79.135450688000006, 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.196 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.197 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:45.198 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:45.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:45.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337358996999995, 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:45.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:45.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337311006999997, 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:45.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:45.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.213 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337272708, 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:45.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:45.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337233920000003, 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337210588999994, 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337180103999998, 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:45.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337145035000006, 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.234 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:45.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:45.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337121292000006, 2024-04-15T23:32:45.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:45.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337097033000006, 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.249 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337068693999996, 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:45.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.337029895000001, 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.255 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:45.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:45.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:45.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.336994723999993, 2024-04-15T23:32:45.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.265 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.336961356000003, 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:45.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:45.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:45.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:45.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.336903895000006, 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:45.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:45.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:45.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:45.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.335268235000001, 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.334376703000004, 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.281 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:45.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.334325355000004, 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:45.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:45.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.291 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 74.334287239000005, 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:45.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:45.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:45.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:45.295 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:45.297 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:45.297 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:45.313+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:45.398 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:45.415+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:45.411 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:45.411 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:45.411 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:45.412 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:45.420 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:45.499 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:45.515+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:45.514 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:45.527 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:45.527 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:45.527 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:45.527 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:45.527 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:45.535 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:45.619 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:45.636+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:45.686 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.630416115000003, 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:45.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.690 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.629723571, 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.629331656999994, 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:45.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.628997212000002, 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:45.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:45.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.627701858999998, 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:45.707 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:45.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.275435995999999, 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:45.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.275212994, 2024-04-15T23:32:45.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.720 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.274772150999993, 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:45.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:45.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:45.725 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.274120194000005, 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:45.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:45.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.273313927000004, 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:45.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:45.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.271213433, 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833749354999995, 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:45.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:45.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:45.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833692611000004, 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:45.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833581455000001, 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:45.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.754 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833494440999999, 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:45.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:45.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:45.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:45.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:45.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833460740000007, 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833272201, 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833227983, 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:45.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:45.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.775 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833187484000007, 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:45.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:45.779 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.833145774000002, 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:45.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:45.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:45.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:45.783 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:45.784 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:45.785 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:45.785 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:45.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:45.786 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:45.801+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:45.787 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:45.787 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:45.787 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:45.787 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:45.886 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:45.901+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:45.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:32:45.901 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:45.901 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:45.908 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:45.992 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.008+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.057 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.057 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.066 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:46.107 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.123+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.189 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:46.205+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:46.215 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.215 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.223 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:46.289 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.306+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.333 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.333 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:46.390 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:46.407+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:46.450 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.450 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.459 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:46.499 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:46.516+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:46.592 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.609+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.606 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.607 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.615 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:46.693 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.709+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.726 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.726 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:46.819 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.835+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.883 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:46.884 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:46.885 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:32:46.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:46.934 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:46.950+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:46.997 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:47.013+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:47.042 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.042 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:47.098 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:47.114+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:47.162 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.162 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.171 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:47.198 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:47.214+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:47.299 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:47.315+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:47.319 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.319 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:47.400 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:47.416+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:47.438 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.438 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.446 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:47.501 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:47.517+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:47.558 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.558 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:47.602 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:47.619+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:47.704 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:47.720+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:47.715 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.715 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:47.789 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:47.804 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:47.821+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:47.833 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:47.833 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:47.841 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:47.906 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:47.922+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:47.925 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:47.925 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:47.953 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:47.953 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:47.957 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:47.958 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:47.958 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:47.962 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:47.963 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:47.963 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:48.006 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:48.023+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:48.071 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:48.071 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:48.071 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:48.071 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:48.072 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:48.081 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:48.124 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:48.141+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:48.191 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:48.191 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:48.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:48.191 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:48.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.135568208999999, 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.134875664999996, 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:48.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:48.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:48.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:48.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:48.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.134483751000005, 2024-04-15T23:32:48.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:48.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:48.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:48.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:48.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.134149305999998, 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:48.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:48.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:48.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.132853952999994, 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:48.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:48.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:48.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:48.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.780588089999995, 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:48.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:48.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:48.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.780365087999996, 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:48.223 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:48.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.779924245000004, 2024-04-15T23:32:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:48.233 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.779272288000001, 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.778466021, 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:48.238 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:48.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:48.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:48.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.776365526999996, 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:48.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:48.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338901449000005, 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.252 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338844705, 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:48.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338733548999997, 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:48.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:48.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338646534999995, 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:48.263 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.268 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338612834000003, 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:48.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338424294999996, 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:48.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338380076999997, 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.279 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:48.284 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338339578000003, 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:48.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.338297867999998, 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:48.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:48.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:48.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:48.292 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:48.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:48.294 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:48.310+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:48.394 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:48.410+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:48.406 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:48.406 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:48.406 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:48.407 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:48.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:48.495 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:48.511+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:48.564 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:48.564 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:48.564 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:48.564 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:48.564 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:48.572 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:48.617 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:48.633+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:48.682 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.628734766999997, 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:48.683 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.688 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.628653279000005, 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:48.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:48.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.694 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830561587999995, 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:48.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:48.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:48.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.700 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830513597999996, 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:48.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:48.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:48.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:48.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:48.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:48.707 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830475299, 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:48.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.713 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830436511000002, 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.718 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830413179999994, 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:48.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:48.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:48.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:48.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:48.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830382694999997, 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:48.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:48.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:48.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:48.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830347626000005, 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:48.730 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:48.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:48.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:48.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:48.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830323883000005, 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.736 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:48.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:48.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:48.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:48.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830299624000006, 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:48.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:48.748 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830271284999995, 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:48.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830232486, 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.754 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.759 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830197315000007, 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:48.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:48.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830163947000003, 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.768 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:48.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:48.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:48.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.830106486000005, 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:48.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:48.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.828470826, 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:48.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:48.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.827579294000003, 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.784 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.827527946000004, 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:48.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:48.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 77.827489830000005, 2024-04-15T23:32:48.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:48.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:48.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:48.799 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:48.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:48.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:32:48.800 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-15T23:32:48.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-15T23:32:48.802 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:48.817+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:48.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:48.901 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:48.918+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:48.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:32:48.914 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:48.914 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:48.914 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:48.914 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:48.923 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:49.003 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.019+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:49.030 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:49.031 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:49.031 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:49.031 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:49.031 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:49.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:49.103 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:49.120+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:49.190 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.134937106999999, 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:49.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.195 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.134244562999996, 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:49.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:49.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.133852649000005, 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.200 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:49.204 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.133518203999998, 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:49.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:49.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:49.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.132222850999995, 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:49.209 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:49.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:49.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:49.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.779956987999995, 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:49.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:49.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:49.218 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.779733985999997, 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:49.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.779293143000004, 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.223 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:49.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:49.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:49.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:49.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.778641186000002, 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:49.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:49.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:49.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.777834919, 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:49.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.775734424999996, 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:49.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.338270347000005, 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.338213603, 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:49.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:49.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:49.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.338102446999997, 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:49.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:49.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:49.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:49.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.338015432999995, 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.337981732000003, 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.264 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:49.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:49.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.269 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.337793192999996, 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:49.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:49.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:49.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.275 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.337748974999997, 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:49.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:49.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.337708476000003, 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.337666765999998, 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:49.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:49.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:49.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:49.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:49.289 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:49.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:49.291 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.307+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:49.312 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:32:49.312 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 37, 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "fsid": "60f632e8-f087-41df-a0b6-043b99131bd6", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "created": "2024-04-15T23:31:15.484738+0000", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "modified": "2024-04-15T23:32:46.898019+0000", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "last_up_change": "2024-04-15T23:32:10.524116+0000", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "last_in_change": "2024-04-15T23:31:16.326489+0000", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_num": 5799936, 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_set": [ 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "pglog_hardlimit", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "purged_snapdirs", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_deletes", 2024-04-15T23:32:49.313 INFO:teuthology.orchestra.run.smithi102.stdout: "sortbitwise" 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_version": 4, 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "full_ratio": 0.94999998807907104, 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_snapshot": "", 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_max": 4, 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd": 3, 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "require_min_compat_client": "luminous", 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "min_compat_client": "luminous", 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "require_osd_release": "squid", 2024-04-15T23:32:49.314 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_crimson": false, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "pools": [ 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 1, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": ".mgr", 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.797113+0000", 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:49.315 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 1, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 1, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 1, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 1, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 1, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:49.316 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:49.317 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:49.318 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:49.319 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_max": 32, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 1 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr": {} 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 2.9900000095367432, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 2.9900000095367432, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:49.320 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 2, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 2, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 2, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "rbd", 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:23.948719+0000", 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:49.321 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:49.322 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 8, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 8, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 8, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 8, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 8, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:49.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "11", 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:49.324 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:49.325 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:49.326 INFO:teuthology.orchestra.run.smithi102.stdout: "options": {}, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd": {} 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.4900000095367432, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.4900000095367432, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:49.327 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 3, 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_metadata", 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:28.382708+0000", 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:49.328 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 32, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 32, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 32, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 32, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 32, 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:49.329 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "14", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:49.330 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:49.331 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:49.332 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_bias": 4, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 16, 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_priority": 5 2024-04-15T23:32:49.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "metadata": "cephfs" 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.690000057220459, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.690000057220459, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-15T23:32:49.334 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "pool": 4, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": "cephfs_data", 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "create_time": "2024-04-15T23:31:29.186157+0000", 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "flags_names": "hashpspool", 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "type": 1, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "size": 2, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": 1, 2024-04-15T23:32:49.335 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_rule": 0, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_count": 0, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_target": 0, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_barrier": 0, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "object_hash": 2, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscale_mode": "off", 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": 64, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num": 64, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_placement_num_target": 64, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_target": 64, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_pending": 64, 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "last_pg_merge_meta": { 2024-04-15T23:32:49.336 INFO:teuthology.orchestra.run.smithi102.stdout: "source_pgid": "0.0", 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "ready_epoch": 0, 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_started": 0, 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "last_epoch_clean": 0, 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "source_version": "0'0", 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "target_version": "0'0" 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "last_change": "15", 2024-04-15T23:32:49.337 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend": "0", 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "last_force_op_resend_preluminous": "0", 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "auid": 0, 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_mode": "selfmanaged", 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_seq": 0, 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_epoch": 0, 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_snaps": [], 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps": "[]", 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_bytes": 0, 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "quota_max_objects": 0, 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "tiers": [], 2024-04-15T23:32:49.338 INFO:teuthology.orchestra.run.smithi102.stdout: "tier_of": -1, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "read_tier": -1, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "write_tier": -1, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_mode": "none", 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_bytes": 0, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "target_max_objects": 0, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_flush_age": 0, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "cache_min_evict_age": 0, 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profile": "", 2024-04-15T23:32:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_params": { 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "none" 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_period": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_count": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "use_gmt_hitset": true, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "min_read_recency_for_promote": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "min_write_recency_for_promote": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_grade_decay_rate": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "hit_set_search_last_n": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "grade_table": [], 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "stripe_width": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "expected_num_objects": 0, 2024-04-15T23:32:49.340 INFO:teuthology.orchestra.run.smithi102.stdout: "fast_read": false, 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "options": { 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num_min": 64, 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "target_size_ratio": 0.89999997615814209 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "application_metadata": { 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "cephfs": { 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "data": "cephfs" 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "read_balance": { 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "score_type": "Fair distribution", 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "score_acting": 1.5800000429153442, 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "score_stable": 1.5800000429153442, 2024-04-15T23:32:49.341 INFO:teuthology.orchestra.run.smithi102.stdout: "optimal_score": 0.67000001668930054, 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_acting": 1.059999942779541, 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "raw_score_stable": 1.059999942779541, 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity_weighted": 1, 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity": 1, 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "average_primary_affinity_weighted": 1 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:49.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "37ee61ed-86ab-4308-a161-cd2aafcfd4f9", 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6800", 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6801", 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.344 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6802", 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6803", 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.345 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6806", 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6807", 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.346 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6804", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.107:6805", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1269237815 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.107:6801/1269237815", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.107:6803/1269237815", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.107:6807/1269237815", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.107:6805/1269237815", 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:49.347 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "9631dded-d96a-40ad-945d-252291b498da", 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 1, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:49.348 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 24, 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 0, 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6800", 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.349 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6801", 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6802", 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.350 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6803", 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.351 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6806", 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6807", 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.352 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6804", 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.115:6805", 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1544615186 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.115:6801/1544615186", 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.115:6803/1544615186", 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.115:6807/1544615186", 2024-04-15T23:32:49.353 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.115:6805/1544615186", 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "exists", 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "up" 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "uuid": "45415c3c-3208-4cab-b6d2-75f250746bef", 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "up": 0, 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "in": 1, 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "weight": 1, 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_affinity": 1, 2024-04-15T23:32:49.354 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_begin": 0, 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "last_clean_end": 0, 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "up_from": 8, 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "up_thru": 13, 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "down_at": 24, 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "lost_at": 0, 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addrs": { 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6800", 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6801", 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addrs": { 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6802", 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.356 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6803", 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addrs": { 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6806", 2024-04-15T23:32:49.357 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6807", 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addrs": { 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-04-15T23:32:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6804", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.195:6805", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2023242123 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "public_addr": "172.21.15.195:6801/2023242123", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_addr": "172.21.15.195:6803/2023242123", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_back_addr": "172.21.15.195:6807/2023242123", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "heartbeat_front_addr": "172.21.15.195:6805/2023242123", 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "state": [ 2024-04-15T23:32:49.359 INFO:teuthology.orchestra.run.smithi102.stdout: "exists" 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_xinfo": [ 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 0, 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.385592+0000", 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:49.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 1, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.370073+0000", 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 0 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "osd": 2, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "down_stamp": "0.000000", 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_probability": 0, 2024-04-15T23:32:49.361 INFO:teuthology.orchestra.run.smithi102.stdout: "laggy_interval": 0, 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "features": 4540701547738038271, 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "old_weight": 0, 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "last_purged_snaps_scrub": "2024-04-15T23:31:21.369726+0000", 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "dead_epoch": 23 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap": [ 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "pgid": "4.9", 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: "osds": [ 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: 0, 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: 1 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-04-15T23:32:49.362 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_items": [], 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_upmap_primaries": [], 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_temp": [], 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "primary_temp": [], 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "blocklist": {}, 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "range_blocklist": {}, 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "erasure_code_profiles": { 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "default": { 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-failure-domain": "osd", 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "k": "2", 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "m": "1", 2024-04-15T23:32:49.363 INFO:teuthology.orchestra.run.smithi102.stdout: "plugin": "jerasure", 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "technique": "reed_sol_van" 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "removed_snaps_queue": [], 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "new_removed_snaps": [], 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "new_purged_snaps": [], 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_node_flags": {}, 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "device_class_flags": {}, 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode": { 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_enabled": false, 2024-04-15T23:32:49.364 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_bucket_count": 0, 2024-04-15T23:32:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "degraded_stretch_mode": 0, 2024-04-15T23:32:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "recovering_stretch_mode": 0, 2024-04-15T23:32:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: "stretch_mode_bucket": 0 2024-04-15T23:32:49.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-04-15T23:32:49.365 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:32:49.367 INFO:tasks.thrashosds.thrasher:j is {'epoch': 37, 'fsid': '60f632e8-f087-41df-a0b6-043b99131bd6', 'created': '2024-04-15T23:31:15.484738+0000', 'modified': '2024-04-15T23:32:46.898019+0000', 'last_up_change': '2024-04-15T23:32:10.524116+0000', 'last_in_change': '2024-04-15T23:31:16.326489+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '37ee61ed-86ab-4308-a161-cd2aafcfd4f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 1269237815}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 1269237815}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 1269237815}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 1269237815}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 1269237815}]}, 'public_addr': '172.21.15.107:6801/1269237815', 'cluster_addr': '172.21.15.107:6803/1269237815', 'heartbeat_back_addr': '172.21.15.107:6807/1269237815', 'heartbeat_front_addr': '172.21.15.107:6805/1269237815', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '9631dded-d96a-40ad-945d-252291b498da', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6800', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6801', 'nonce': 1544615186}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6802', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6803', 'nonce': 1544615186}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6806', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6807', 'nonce': 1544615186}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6804', 'nonce': 1544615186}, {'type': 'v1', 'addr': '172.21.15.115:6805', 'nonce': 1544615186}]}, 'public_addr': '172.21.15.115:6801/1544615186', 'cluster_addr': '172.21.15.115:6803/1544615186', 'heartbeat_back_addr': '172.21.15.115:6807/1544615186', 'heartbeat_front_addr': '172.21.15.115:6805/1544615186', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '45415c3c-3208-4cab-b6d2-75f250746bef', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 13, 'down_at': 24, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6800', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6801', 'nonce': 2023242123}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6802', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6803', 'nonce': 2023242123}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6806', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6807', 'nonce': 2023242123}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6804', 'nonce': 2023242123}, {'type': 'v1', 'addr': '172.21.15.195:6805', 'nonce': 2023242123}]}, 'public_addr': '172.21.15.195:6801/2023242123', 'cluster_addr': '172.21.15.195:6803/2023242123', 'heartbeat_back_addr': '172.21.15.195:6807/2023242123', 'heartbeat_front_addr': '172.21.15.195:6805/2023242123', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.385592+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.370073+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-15T23:31:21.369726+0000', 'dead_epoch': 23}], 'pg_upmap': [{'pgid': '4.9', 'osds': [0, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-15T23:32:49.367 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.9 2024-04-15T23:32:49.367 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 4.9 2024-04-15T23:32:49.391 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.407+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:49.401 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:49.401 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:49.402 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:49.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:49.493 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.509+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:49.518 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:49.519 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:49.519 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:49.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:49.593 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.610+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:49.637 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.637 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.583107142000003, 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:49.638 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.639 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.640 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:49.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:49.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.644 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.583025653999997, 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:49.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:49.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784933963, 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:49.652 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:49.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.658 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784885973000002, 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:49.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:49.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:49.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:49.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:49.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784847674000005, 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:49.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:49.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.673 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784808885999993, 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:49.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:49.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784785554999999, 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:49.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.686 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784755070000003, 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:49.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:49.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784720000999997, 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:49.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:49.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784696257999997, 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:49.698 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:49.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:49.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784671998999997, 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:49.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:49.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:49.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.712 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.78464366, 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:49.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:49.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.718 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784604861000005, 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:49.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:49.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.724 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784569689999998, 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:49.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784536321999994, 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:49.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.784478860999997, 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.736 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.741 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.782843201000006, 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.746 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.781951668999994, 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:49.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:49.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:49.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:49.752 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.781900320999995, 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:49.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:49.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:49.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:49.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 78.781862204999996, 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:49.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:49.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:49.761 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:49.762 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:49.763 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:49.779+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:49.764 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:49.864 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.880+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:49.874 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:49.874 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:49.875 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:49.884 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:49.899 INFO:teuthology.orchestra.run.smithi102.stderr:clear 4.9 pg_upmap mapping 2024-04-15T23:32:49.899 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:32:49.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:49.968 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:49.984+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.031 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:50.031 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:50.031 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:50.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:50.081 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.097+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:50.127 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:50.128 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:50.128 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:50.131 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:50.132 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:50.166 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:50.183+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:50.187 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.187 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:50.266 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.283+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.307 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.307 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:50.367 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.384+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-04-15T23:32:50.423 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.423 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:50.477 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:50.493+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:50.542 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.542 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:50.594 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.611+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.660 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.660 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.669 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:50.669 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.685+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.770 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.786+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.817 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.817 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.826 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:50.909 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:50.926+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:50.972 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:50.988+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:50.973 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:50.973 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:50.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:51.072 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:51.089+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:51.095 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.095 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.104 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:51.174 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:51.190+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:51.254 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.254 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:51.307 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:51.324+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:51.371 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.372 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.376 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:51.392+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:51.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:51.477 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:51.494+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:51.489 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.489 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:51.581 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:51.598+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:51.646 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.646 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:51.679 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:51.696+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:51.780 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:51.797+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:51.804 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.805 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:51.881 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:51.897+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:51.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:32:51.923 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:51.923 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:51.932 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:51.982 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:51.998+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:52.081 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:52.081 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:52.082 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:52.099+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:52.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:52.132 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:52.183 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:52.200+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:52.242 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:52.242 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:52.251 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:52.273 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:52.273 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:52.291 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:52.292 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:52.292 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:52.295 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:52.312+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:52.296 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:52.296 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:52.360 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:52.361 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:52.361 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:52.361 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:52.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:52.386 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:52.402+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:52.486 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:52.503+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:52.518 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:52.519 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:52.527 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:52.587 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:52.604+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:52.677 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.621904170999997, 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.621211626999994, 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.688 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.620819713000003, 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:52.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:52.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.620485267999996, 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.693 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:52.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:52.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:52.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:52.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:52.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:52.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:52.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:52.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:52.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.619189915000007, 2024-04-15T23:32:52.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:52.702 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.702 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.702 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.702 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:52.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.266924051999993, 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:52.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.266701049999995, 2024-04-15T23:32:52.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:52.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.266260207000002, 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:52.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:52.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.26560825, 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.264801982999998, 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:52.729 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:52.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:52.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.262701488999994, 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:52.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:52.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.825237411000003, 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:52.740 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:52.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:52.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:52.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:52.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:52.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:52.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:52.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:52.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:52.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:52.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:52.750 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.825180666999998, 2024-04-15T23:32:52.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:52.750 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.751 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:52.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:52.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:52.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:52.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:52.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:52.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:52.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:52.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:52.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:52.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:52.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:52.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:52.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:52.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:52.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:52.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:52.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:52.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:52.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:52.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:52.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:52.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.763 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.764 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:52.764 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.825069510999995, 2024-04-15T23:32:52.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:52.764 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:52.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.769 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.824982496999993, 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:52.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.824948796000001, 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:52.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.824760256999994, 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:52.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.787 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.824716038999995, 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:52.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.824675540000001, 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:52.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:52.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.797 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.824633829999996, 2024-04-15T23:32:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:52.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:52.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:52.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:52.802 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:52.804 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:52.805 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:52.820+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:52.904 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:52.921+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:52.917 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:52.917 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:52.917 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:52.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:53.010 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:53.027+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:53.075 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:53.075 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:53.075 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:53.076 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:53.076 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:53.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:53.126 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:53.142+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:53.207 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:53.223+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.180201769999996, 2024-04-15T23:32:53.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:53.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:53.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.180120282000004, 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:53.240 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:53.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:53.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.382028590999994, 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:53.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381980600999995, 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.251 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:53.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381942301999999, 2024-04-15T23:32:53.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:53.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:53.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381903514000001, 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:53.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381880183000007, 2024-04-15T23:32:53.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:53.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:53.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:53.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.275 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381849697999996, 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:53.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:53.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:53.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381814629000004, 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:53.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381790886000005, 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:53.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:53.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381766627000005, 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381738287999994, 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:53.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:53.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:53.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:53.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:53.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:53.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:53.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.305 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.306 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.306 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:53.306 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381699488999999, 2024-04-15T23:32:53.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:53.307 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.307 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.307 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.307 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:53.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:53.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381664318000006, 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:53.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:53.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:53.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:53.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381630950000002, 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.320 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:53.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:53.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:53.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:53.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:53.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.327 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.328 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.328 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:53.328 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.381573489000004, 2024-04-15T23:32:53.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:53.328 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:53.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:53.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.379937828999999, 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:53.334 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.379046297000002, 2024-04-15T23:32:53.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.378994949000003, 2024-04-15T23:32:53.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:53.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 82.378956833000004, 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:53.349 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:53.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:53.353 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:32:53.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:53.356 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:53.371+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:53.455 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:53.472+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:53.468 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:53.468 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:53.468 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:53.468 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:53.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:53.561 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:53.578+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:53.625 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:53.626 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:53.626 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:53.626 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:53.626 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:53.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:53.657 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:53.674+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:53.758 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:53.775+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:53.789 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:53.789 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:53.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:53.790 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:53.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.790 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:53.790 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:53.791 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.732678460000002, 2024-04-15T23:32:53.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:53.791 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.791 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:53.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:53.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:53.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:53.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:53.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:53.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:53.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:53.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:53.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:53.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:53.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:53.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.801 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.802 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:53.802 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:53.802 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.731985915999999, 2024-04-15T23:32:53.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:53.802 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.803 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:53.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:53.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:53.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:53.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:53.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:53.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:53.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:53.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:53.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:53.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:53.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:53.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:53.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.813 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:53.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:53.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.731594001999994, 2024-04-15T23:32:53.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:53.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.814 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:53.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:53.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:53.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:53.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:53.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:53.824 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.731259557000001, 2024-04-15T23:32:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.825 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:53.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:53.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:53.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:53.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:53.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:53.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:53.834 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.729964203999998, 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:53.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.377698340999999, 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:53.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.844 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.377475339, 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:53.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:53.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:53.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.377034495999993, 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:53.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.376382539000005, 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.857 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.375576272000004, 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:53.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:53.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:53.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:53.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:53.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.863 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.863 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:53.863 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.373475778, 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:53.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:53.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.936011699999995, 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:53.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:53.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935954956000003, 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:53.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:53.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.884 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935843800000001, 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.885 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:53.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:53.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:53.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.890 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935756785999999, 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:53.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935723085000006, 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935534546, 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.906 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935490328, 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:53.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:53.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935449829000007, 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.915 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.935408119000002, 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:53.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:53.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:53.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:53.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:53.920 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:53.921 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:53.922 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:53.938+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:54.022 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:54.039+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:54.031 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:54.031 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:54.031 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:54.031 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:54.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:54.123 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:54.140+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:54.149 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:54.149 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:54.149 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:54.158 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:54.224 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:54.241+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:54.268 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:54.268 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.214586573000005, 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:54.269 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:54.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:54.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 88.214505084999999, 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:54.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.280 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416413394000003, 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.285 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416365404000004, 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:54.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:54.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:54.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.291 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416327104999993, 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:54.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:54.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:54.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:54.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416288316999996, 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416264986000002, 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.302 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:54.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:54.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:54.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:54.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:54.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416234501000005, 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:54.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:54.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:54.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:54.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:54.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:54.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:54.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:54.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:54.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:54.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:54.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:54.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:54.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:54.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:54.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:54.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:54.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:54.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:54.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:54.321 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.322 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.322 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.322 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.322 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:54.323 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416199431999999, 2024-04-15T23:32:54.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:54.323 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.323 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.323 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.323 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:54.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:54.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:54.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:54.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:54.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:54.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:54.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:54.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:54.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:54.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:54.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:54.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:54.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:54.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:54.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:54.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:54.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:54.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:54.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:54.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:54.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416175688999999, 2024-04-15T23:32:54.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:54.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:54.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:54.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:54.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:54.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:54.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:54.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:54.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:54.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:54.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:54.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:54.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:54.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:54.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:54.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:54.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:54.346 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.346 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.347 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.347 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.347 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:54.348 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416151429999999, 2024-04-15T23:32:54.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:54.348 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.348 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.348 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.348 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:54.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:54.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:54.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:54.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:54.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.360 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416123091000003, 2024-04-15T23:32:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.361 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:54.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:54.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:54.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:54.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.371 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416084291999994, 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:54.372 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:54.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:54.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:54.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:54.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:54.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:54.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416049121, 2024-04-15T23:32:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:54.384 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:54.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:54.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.416015752999996, 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:54.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:54.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:54.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:54.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.415958291999999, 2024-04-15T23:32:54.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:54.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.413 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:54.414 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.414322631999994, 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:54.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.413431099999997, 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.423 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.428 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.413379751999997, 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:54.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:54.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.433 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 83.413341635999998, 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:54.435 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:54.436 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.437 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:54.438 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:54.438 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:54.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:54.440 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:54.456+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:54.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:54.540 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:54.557+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:54.551 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:54.551 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:54.551 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:54.552 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:54.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:54.585 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:54.616 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:54.618 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:54.621 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:54.621 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:54.642 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:54.658+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:54.668 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:54.668 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:54.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:54.743 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:54.759+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:54.785 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:54.785 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:54.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:54.843 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:54.860+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:54.906 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:54.907 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:54.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:54.921 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-15T23:32:54.921 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-04-15T23:32:54.921 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:32:54.921 INFO:teuthology.orchestra.console.smithi195:Power on 2024-04-15T23:32:54.922 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T23:32:54.944 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:54.961+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:54.950 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2024-04-15T23:32:54.950 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:32:54.975 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-15T23:32:55.046 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:55.063+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:55.068 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.069 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:55.147 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:55.163+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:55.226 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.226 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:55.279 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:55.295+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:55.342 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.343 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.348 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:55.365+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:55.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:55.356 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:32:55.449 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:55.466+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:55.498 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.499 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.507 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:55.550 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:55.567+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:55.614 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.615 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.623 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:55.651 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:55.668+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:55.732 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.732 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.741 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:55.751 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:55.768+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:55.848 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:55.848 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:55.853 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:55.869+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:55.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:55.954 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:55.971+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.006 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.007 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:56.059 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:56.076+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:56.125 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.125 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.133 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:56.156 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:56.173+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-04-15T23:32:56.257 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:56.274+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.281 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.281 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.283 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:32:56.289 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:56.358 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:56.375+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.398 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.398 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:56.459 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:56.476+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:56.516 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.516 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:56.561 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:56.577+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:56.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:32:56.633 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.633 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.642 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:56.662 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:56.679+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:56.751 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:56.751 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:56.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:56.763 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:56.780+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.777 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:56.777 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:56.796 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:56.797 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:56.797 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:56.801 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:56.801 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:56.864 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:56.881+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.870 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:56.870 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:56.870 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:56.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:56.966 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:56.982+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:56.987 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:56.987 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:56.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:57.067 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:57.083+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:57.106 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:57.106 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.050755541000001, 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:57.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.111 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.050062996999998, 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:57.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:57.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:57.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:57.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:57.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.049671083000007, 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:57.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.049336638, 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:57.122 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:57.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:57.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.048041284999996, 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.127 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:57.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.695775421999997, 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:57.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:57.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.695552419999999, 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.695111577000006, 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:57.146 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.694459620000003, 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:57.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:57.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.693653353000002, 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:57.151 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:57.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:57.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:57.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.691552858999998, 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:57.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:57.160 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.254088780999993, 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:57.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:57.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:57.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:57.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.254032037000002, 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:57.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.253920880999999, 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:57.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.253833866999997, 2024-04-15T23:32:57.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:57.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.253800166000005, 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.186 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:57.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:57.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.253611626999998, 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:57.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:57.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.253567408999999, 2024-04-15T23:32:57.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:57.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:57.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.253526910000005, 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:57.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:57.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:57.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.2534852, 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:57.207 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:57.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:57.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:57.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:57.211 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:57.213 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:57.213 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:57.229+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:57.313 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:57.330+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:57.323 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:57.323 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:57.323 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:57.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:57.416 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:57.433+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:57.480 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:57.481 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:57.481 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:57.481 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:57.481 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:57.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:57.530 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:57.547+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:57.617 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:57.634+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:57.640 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.586162443999996, 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.641 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:57.642 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:57.643 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:57.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.646 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.586080956000004, 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:57.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:57.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:57.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787989264999993, 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:57.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:57.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.656 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787941274999994, 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.658 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:57.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:57.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:57.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:57.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787902975999998, 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:57.663 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.668 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787864188, 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.670 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:57.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787840857000006, 2024-04-15T23:32:57.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:57.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:57.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:57.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:57.680 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787810371999996, 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:57.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787775303000004, 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.686 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:57.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:57.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:57.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.691 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787751560000004, 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:57.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:57.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787727301000004, 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:57.697 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:57.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:57.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:57.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787698961999993, 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:57.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:57.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:57.708 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787660162999998, 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:57.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787624992000005, 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:57.714 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:57.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:57.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.719 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787591624000001, 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:57.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:57.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.787534163000004, 2024-04-15T23:32:57.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:57.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:57.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.731 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.785898502999999, 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:57.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:57.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:57.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:57.736 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.785006971000001, 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:57.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:57.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:57.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:57.742 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.784955623000002, 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:57.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.747 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 86.784917507000003, 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:57.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:57.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:57.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:57.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.752 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:57.752 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:57.752 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:57.753 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:57.770+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:57.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:57.854 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:57.870+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:57.866 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:57.866 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:57.866 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:57.866 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:57.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:57.959 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:57.976+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:58.024 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:58.024 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:58.024 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:32:58.024 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:32:58.024 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:58.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:58.074 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:58.091+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:58.157 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:58.174+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:58.186 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:58.186 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:32:58.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:32:58.186 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 92.128228949000004, 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:32:58.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 92.127536405000001, 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:58.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:32:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 92.127144490999996, 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:32:58.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:32:58.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 92.126810046000003, 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:32:58.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:32:58.206 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 92.125514693, 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:32:58.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:32:58.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.77324883, 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.773025828000002, 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:32:58.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:32:58.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.772584984999995, 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:204 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'150, mlcod=10'145)", 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.771933028000007, 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062755459999999999, 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427707+0000", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427708+0000", 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9800000000000003e-07 2024-04-15T23:32:58.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427712+0000", 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000001e-06 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427721+0000", 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5929999999999995e-06 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427726+0000", 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000001e-06 2024-04-15T23:32:58.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430491+0000", 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027656809999999999 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430503+0000", 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1513e-05 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433959+0000", 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003456499 2024-04-15T23:32:58.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433983+0000", 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3175000000000001e-05 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.771126761000005, 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:58.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.769026267000001, 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.235 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331562188999996, 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:32:58.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:58.240 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331505445000005, 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:32:58.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:32:58.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:58.245 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331394289000002, 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:32:58.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:32:58.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:32:58.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:32:58.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.250 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331307275, 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:32:58.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:32:58.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:32:58.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331273573999994, 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:32:58.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331085035000001, 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:32:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:32:58.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331040817000002, 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:32:58.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.331000317999994, 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.330958608000003, 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:32:58.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:32:58.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:32:58.278 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:58.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:58.280 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:58.296+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:58.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:32:58.380 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:58.397+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:58.392 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:58.392 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:58.392 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:32:58.392 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:58.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:58.481 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:58.498+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:58.509 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:58.509 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:32:58.509 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:32:58.509 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:32:58.509 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:58.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:58.603 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:58.620+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:58.669 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.615441400999998, 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.670 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:32:58.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:32:58.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.615359913000006, 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:32:58.676 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:32:58.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:58.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:32:58.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:32:58.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:32:58.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817268221999996, 2024-04-15T23:32:58.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:32:58.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.688 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817220231999997, 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:58.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:32:58.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817181933000001, 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:32:58.694 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:32:58.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:32:58.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.699 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817143145000003, 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:58.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.702 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.703 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:58.705 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817119813999994, 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:32:58.710 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817089328999998, 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:32:58.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:32:58.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817054260000006, 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:32:58.716 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:32:58.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:32:58.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:32:58.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817030517000006, 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:32:58.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:32:58.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:32:58.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.817006258000006, 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.727 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:32:58.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.732 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.816977918999996, 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:32:58.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.738 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.816939120000001, 2024-04-15T23:32:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:32:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:32:58.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.816903948999993, 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:32:58.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:32:58.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.816870581000003, 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:32:58.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.755 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.816813120000006, 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:32:58.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:32:58.760 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.815177460000001, 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:32:58.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.766 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.814285928000004, 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:32:58.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:32:58.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.814234580000004, 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:32:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:32:58.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:32:58.777 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 87.814196464000005, 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:32:58.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:32:58.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:32:58.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:32:58.781 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:32:58.783 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:58.799+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:58.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:58.803 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:32:58.883 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:58.900+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:58.896 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:32:58.896 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:32:58.897 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:32:58.897 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:32:58.905 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:58.932 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:32:58.932 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:32:58.950 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:32:58.951 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:32:58.951 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:32:58.954 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:32:58.954 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:32:58.976 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:32:58.990 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:59.007+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:59.054 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.054 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:59.086 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-15T23:32:59.104 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:59.121+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:59.187 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:59.203+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:59.212 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.212 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.221 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:32:59.287 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:32:59.288 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:59.304+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:59.332 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.332 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:32:59.388 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:59.405+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:59.448 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.449 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.457 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:32:59.498 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:59.515+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:59.591 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:59.607+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:59.605 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.606 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.614 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:32:59.691 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:32:59.708+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:32:59.723 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.724 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:32:59.792 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:59.809+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:59.881 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.881 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:32:59.889 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:32:59.893 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:32:59.910+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:59.993 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:00.010+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:32:59.997 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:32:59.997 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.006 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:00.094 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:00.111+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:00.116 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.116 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:00.209 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:00.226+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:00.273 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.273 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.281 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:00.322 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:00.339+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:00.397 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:00.414+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:00.430 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.430 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.439 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:00.483 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '461a84e6fbbf089011eafd13b98169fb9e9b8cc9'. 2024-04-15T23:33:00.483 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.484 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T23:33:00.485 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:00.485 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 461a84e6fbb Merge pull request #56863 from cbodley/wip-65467-squid 2024-04-15T23:33:00.487 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-15T23:33:00.497 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:00.514+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:00.523 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-15T23:33:00.525 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T23:33:00.526 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-15T23:33:00.550 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.550 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:00.601 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:00.618+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:00.699 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:00.716+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:00.708 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.708 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:00.801 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:00.818+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:00.866 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.866 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:00.918 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:00.935+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:00.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:00.988 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:00.988 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:00.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:01.002 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:01.018+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:01.085 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:01.086 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:01.103 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:01.120+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:01.105 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:01.106 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:01.106 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:01.109 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:01.109 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:01.146 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:01.146 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:01.146 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:01.147 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:01.147 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:01.156 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:01.207 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-15T23:33:01.240 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:01.257+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:01.272 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-15T23:33:01.303 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:33:01.304 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:01.321+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 95.252778801000005, 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.307 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:01.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:01.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 95.252697312999999, 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.313 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:01.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454605622000003, 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.323 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454557632000004, 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:01.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:01.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:01.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:01.328 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454519332999993, 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:01.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:01.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:01.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:01.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454480544999996, 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454457214000001, 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.339 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:01.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:01.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:01.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:01.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454426729000005, 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.344 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454391659999999, 2024-04-15T23:33:01.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.354 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454367916999999, 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.359 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454343657999999, 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:01.364 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454315319000003, 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454276519999993, 2024-04-15T23:33:01.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:01.374 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454241349, 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:01.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:01.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:01.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:01.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454207980999996, 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:01.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.384 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.454150519999999, 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:01.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:01.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:01.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:01.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:01.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.452514859999994, 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:01.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.451623327999997, 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.395 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:01.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.451571979999997, 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:01.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 90.451533863999998, 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:01.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:01.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:01.409 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:01.410 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:01.412 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:01.428+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:01.412 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:01.413 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-15T23:33:01.413 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T23:33:01.413 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-15T23:33:01.413 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-15T23:33:01.413 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:33:01.413 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-15T23:33:01.468 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-04-15T23:33:01.470 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-04-15T23:33:01.470 DEBUG:teuthology.orchestra.run.smithi102:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-04-15T23:33:01.512 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:01.528+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:01.523 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:01.523 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:01.523 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:01.524 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:01.531 INFO:tasks.workunit.client.0.smithi102.stderr:+ set -e 2024-04-15T23:33:01.531 INFO:tasks.workunit.client.0.smithi102.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-04-15T23:33:01.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:01.534 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into 'xfstests-dev'... 2024-04-15T23:33:01.613 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:01.630+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:01.681 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:01.681 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:01.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:01.733 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:01.750+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:01.800 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:01.800 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:01.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:01.800 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.744739405999994, 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:33:01.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:33:01.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:33:01.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.744046862000005, 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:33:01.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:33:01.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:33:01.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.743654948, 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:01.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.743320503000007, 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.742025150000003, 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:33:01.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.389759287000004, 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:33:01.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.389536285000005, 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:33:01.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.389095441999999, 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:33:01.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:33:01.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:33:01.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.387637217999995, 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.385536724000005, 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.843 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.948072646, 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.948015901999995, 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:01.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:01.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:01.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:01.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947904746000006, 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:01.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:01.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:01.859 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947817732000004, 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947784030999998, 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.871 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947595492000005, 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:01.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:33:01.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:33:01.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:33:01.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:33:01.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947551274000006, 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:01.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947510774999998, 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.947469065000007, 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:47 3.14 e43/12 3:292cf221:::200.00000000:head v 43'12, mlcod=16'9)", 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22934694999999999, 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068306599999999997, 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:01.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0399999999999996e-07 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586808+0000", 2024-04-15T23:33:01.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.301e-06 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586817+0000", 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7450000000000001e-06 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586822+0000", 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4490000000000001e-06 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586854+0000", 2024-04-15T23:33:01.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2450999999999998e-05 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586867+0000", 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2712e-05 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.593608+0000", 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067413209999999998 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.593634+0000", 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6177e-05 2024-04-15T23:33:01.893 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:01.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:01.894 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:01.896 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:01.896 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:01.912+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:01.996 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:02.013+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:02.004 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:02.004 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:02.004 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:02.004 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:02.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:02.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-04-15T23:33:02.098 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:02.115+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:02.161 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:02.161 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:02.162 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:02.162 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:02.162 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:02.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:02.198 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:02.215+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:02.299 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:02.316+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:02.309 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:33:02.320 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:02.320 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:02.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.266668977999998, 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:02.321 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:02.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.266587490000006, 2024-04-15T23:33:02.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:02.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:02.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468495798999996, 2024-04-15T23:33:02.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468447808999997, 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:02.339 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:02.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.344 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468409510000001, 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:02.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:02.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:02.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:02.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468370722000003, 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:02.351 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:02.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:02.356 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468347390999995, 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:02.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.362 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468316905999998, 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:02.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:02.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468281837000006, 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.368 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:02.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:02.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:02.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:02.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:02.374 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468258094000007, 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:02.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468233835000007, 2024-04-15T23:33:02.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:02.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:33:02.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:02.386 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468205495999996, 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:02.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:02.391 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468166697000001, 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:02.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:02.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:02.397 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468131525999993, 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:02.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:02.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:02.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:02.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468098158000004, 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.403 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.404 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:02.405 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.406 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.407 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.408 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.468040697000006, 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.409 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.410 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.411 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:02.412 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.413 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.414 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.466405037000001, 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.415 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.416 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.417 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.418 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:02.419 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.465513505000004, 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:02.420 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.421 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.422 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:02.423 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:02.424 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.425 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.465462157000005, 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.426 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.427 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.428 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.429 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:33:02.430 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 91.465424041000006, 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:02.431 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:02.432 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.433 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:02.434 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:02.435 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:02.437 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:02.453+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:02.438 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:02.537 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:02.554+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:02.548 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:02.548 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:02.548 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:02.548 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:02.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:02.638 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:02.655+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:02.664 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:02.664 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:02.664 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:02.664 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:02.665 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:02.673 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:02.739 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:02.756+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:02.783 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:158 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'112, mlcod=10'107)", 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.727982350000005, 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080436239999999992, 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071411+0000", 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8500000000000002e-07 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071479+0000", 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7119999999999994e-05 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071484+0000", 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.592e-06 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071487+0000", 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2109999999999998e-06 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071523+0000", 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6125999999999999e-05 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.071541+0000", 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7952e-05 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079411+0000", 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078692439999999992 2024-04-15T23:33:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079455+0000", 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4094000000000002e-05 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:159 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'113, mlcod=10'109)", 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.727289806000002, 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073852700000000002, 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072104+0000", 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9499999999999998e-07 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072107+0000", 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5040000000000001e-06 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072112+0000", 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0760000000000002e-06 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072115+0000", 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7280000000000001e-06 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072143+0000", 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7951999999999999e-05 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072154+0000", 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1009000000000001e-05 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079457+0000", 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073028939999999999 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079489+0000", 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1812e-05 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:160 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'114, mlcod=10'109)", 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.726897891999997, 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070293029999999998, 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072496+0000", 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9400000000000005e-07 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072500+0000", 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1309999999999999e-06 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072510+0000", 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5689999999999994e-06 2024-04-15T23:33:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072515+0000", 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6040000000000003e-06 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072554+0000", 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9835000000000001e-05 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072573+0000", 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8159999999999999e-05 2024-04-15T23:33:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079490+0000", 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069177650000000002 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079525+0000", 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4644999999999998e-05 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:161 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'115, mlcod=10'109)", 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.726563447000004, 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067199039999999996, 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072830+0000", 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8999999999999998e-07 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072887+0000", 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6524000000000003e-05 2024-04-15T23:33:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072893+0000", 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7409999999999998e-06 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072896+0000", 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3560000000000001e-06 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072927+0000", 2024-04-15T23:33:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0670000000000003e-05 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.072937+0000", 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0786e-05 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079526+0000", 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065887239999999998 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.079550+0000", 2024-04-15T23:33:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3813000000000001e-05 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:164 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'118, mlcod=10'109)", 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.725268094, 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083126020000000005, 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074125+0000", 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074126+0000", 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.13e-07 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074150+0000", 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4303000000000001e-05 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074160+0000", 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7860000000000008e-06 2024-04-15T23:33:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074169+0000", 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9630000000000004e-06 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074200+0000", 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1313999999999999e-05 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.074212+0000", 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1653e-05 2024-04-15T23:33:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082406+0000", 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081936960000000003 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.082438+0000", 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2274000000000003e-05 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:201 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'147, mlcod=10'145)", 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.373002231000001, 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007501158, 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426391+0000", 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426393+0000", 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426403+0000", 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559999999999994e-06 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426427+0000", 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.41e-05 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426438+0000", 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1776e-05 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426550+0000", 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011131700000000001 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426569+0000", 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9454999999999999e-05 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433866+0000", 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072969159999999996 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433892+0000", 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6347999999999999e-05 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:202 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'148, mlcod=10'145)", 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.372779229000002, 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073105679999999999, 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426614+0000", 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426615+0000", 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.41e-07 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426617+0000", 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5359999999999999e-06 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426622+0000", 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000002e-06 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426625+0000", 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4010000000000001e-06 2024-04-15T23:33:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426841+0000", 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021566900000000001 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.426853+0000", 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2328e-05 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433895+0000", 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070421310000000001 2024-04-15T23:33:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433925+0000", 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9672e-05 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:203 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'149, mlcod=10'145)", 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.372338385999996, 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069032010000000003, 2024-04-15T23:33:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427055+0000", 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427056+0000", 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4900000000000001e-07 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427124+0000", 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8176999999999995e-05 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427131+0000", 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9870000000000002e-06 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427135+0000", 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8249999999999998e-06 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427174+0000", 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9650999999999997e-05 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.427191+0000", 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6813e-05 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433926+0000", 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067350709999999996 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433958+0000", 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2227999999999997e-05 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.370880162000006, 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:33:02.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:33:02.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:207 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'153, mlcod=10'145)", 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.368779668000002, 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065897780000000001, 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430614+0000", 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8999999999999996e-07 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430619+0000", 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8729999999999998e-06 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430628+0000", 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0510000000000002e-06 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430636+0000", 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433669+0000", 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030335990000000001 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.433682+0000", 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2559e-05 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437184+0000", 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035017519999999999 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437204+0000", 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9884000000000001e-05 2024-04-15T23:33:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.931315589999997, 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.931258846000006, 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.931147690000003, 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.931060676000001, 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.931026974999995, 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.930838436000002, 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:33:02.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:33:02.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:33:02.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:33:02.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.930794218000003, 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:02.863 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.930753718999995, 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:02.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:02.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.930712009000004, 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:33:02.867 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:47 3.14 e43/12 3:292cf221:::200.00000000:head v 43'12, mlcod=16'9)", 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.2125898939999999, 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068306599999999997, 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:02.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:02.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586804+0000", 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0399999999999996e-07 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586808+0000", 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.301e-06 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586817+0000", 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7450000000000001e-06 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586822+0000", 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4490000000000001e-06 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586854+0000", 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2450999999999998e-05 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.586867+0000", 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2712e-05 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.593608+0000", 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067413209999999998 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:01.593634+0000", 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6177e-05 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:02.875 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:02.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:02.878 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:02.893+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:02.978 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:02.995+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:02.990 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:02.990 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:02.990 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:02.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:03.078 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:03.095+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:03.088 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:33:03.108 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:03.108 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:03.108 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:03.108 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:03.108 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:03.110 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:03.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:03.179 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:03.196+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:03.201 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.173050797000002, 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.227 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:03.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 97.172969308999996, 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.233 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:03.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:03.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374877617999999, 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:03.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:03.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374829628000001, 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.245 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:03.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:03.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:03.250 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374791329000004, 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374752541000007, 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:03.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:03.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:03.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374729209999998, 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.261 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:03.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:03.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.266 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374698725000002, 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:03.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374663655999996, 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.272 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.277 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374639912999996, 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:03.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374615653999996, 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.283 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:33:03.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374587314999999, 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:03.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:03.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.293 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374548516000004, 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:03.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:03.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374513344999997, 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:03.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:03.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:03.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:03.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.305 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374479976999993, 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.374422515999996, 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:03.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:03.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:03.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:03.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.372786856000005, 2024-04-15T23:33:03.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:03.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:03.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.321 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.371895323999993, 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:03.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:03.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.371843975999994, 2024-04-15T23:33:03.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:33:03.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.332 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 92.371805859999995, 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:03.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:03.336 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.337 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.337 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.337 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:03.337 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:03.337 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:03.337 INFO:teuthology.orchestra.console.smithi195:Power on completed 2024-04-15T23:33:03.338 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:03.339 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:03.355+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:03.339 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:03.340 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:03.340 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:03.341 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:03.342 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:03.439 DEBUG:teuthology.orchestra.console.smithi195:Waiting for login prompt 2024-04-15T23:33:03.439 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi195 2024-04-15T23:33:03.449 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:03.456+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:03.451 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:03.451 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:03.460 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:03.540 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:03.557+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:03.609 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:03.609 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:03.618 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:03.661 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:03.678+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:03.725 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:03.725 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:03.735 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:03.779 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:03.796+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:03.843 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:03.859+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:03.848 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:03.848 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:03.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:03.944 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:03.961+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.009 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.009 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:04.058 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.075+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.146 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:04.163+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:04.176 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.176 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.185 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:04.247 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.263+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.306 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.306 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.315 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:04.348 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.365+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.432 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.432 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:33:04.441 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:04.449 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.466+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.550 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.566+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.556 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.556 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:04.650 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:04.667+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:04.684 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.684 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:04.752 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.769+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.811 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.812 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:04.863 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:04.880+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:04.953 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:04.970+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:04.981 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:04.982 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:04.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:05.054 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:05.071+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:05.109 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:05.109 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:05.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:05.154 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:05.171+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:05.236 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:05.236 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:05.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:05.291 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:05.308+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:05.302 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:33:05.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:05.357 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:05.373+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:05.373 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:05.374 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:05.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:05.457 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:05.474+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:05.483 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:05.484 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:05.502 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:05.502 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:05.505 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:05.505 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:05.505 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:05.508 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:05.509 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:05.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:05.559 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:05.575+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:05.660 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:05.677+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:05.667 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:05.667 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:05.667 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:05.667 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:05.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:05.761 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:05.778+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.789086300999998, 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.843 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.789004813000005, 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.849 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:05.850 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990913121999995, 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.854 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:05.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.858 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.859 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.860 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990865131999996, 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:05.861 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.862 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.863 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:05.864 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:05.865 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990826833, 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.866 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.867 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.868 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.869 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.870 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:05.871 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990788045000002, 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:05.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:05.874 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:05.875 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.876 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990764713999994, 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.877 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.878 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.879 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.880 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.881 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990734228999997, 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.882 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:05.883 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:05.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:05.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:05.886 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990699160000005, 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.887 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.888 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.889 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:05.890 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.891 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990675417000006, 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.892 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.893 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.894 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.895 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:05.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.897 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990651158000006, 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011553383, 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.898 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867868+0000", 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5400000000000001e-07 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867871+0000", 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.667e-06 2024-04-15T23:33:05.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867877+0000", 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7089999999999996e-06 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867884+0000", 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3090000000000001e-06 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873808+0000", 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059245859999999999 2024-04-15T23:33:05.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873943+0000", 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013509500000000001 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874106+0000", 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000162628 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879294+0000", 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0051877800000000003 2024-04-15T23:33:05.901 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879337+0000", 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.3272000000000002e-05 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879383+0000", 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5587999999999998e-05 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879421+0000", 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8195000000000003e-05 2024-04-15T23:33:05.902 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990622818999995, 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.903 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.904 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.905 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:05.906 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:05.907 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.99058402, 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.908 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.909 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.910 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.911 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.912 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990548849000007, 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.913 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.914 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.915 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:05.916 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.917 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:05.918 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990515481000003, 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.919 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:05.920 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.921 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:05.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.923 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.990458020000005, 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.98882236, 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:05.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.987930828000003, 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.934 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:05.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:05.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:05.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.987879480000004, 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011498049, 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.939 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870639+0000", 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870640+0000", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3399999999999998e-07 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870646+0000", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0179999999999998e-06 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870656+0000", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0028e-05 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870662+0000", 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7559999999999996e-06 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874157+0000", 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.003495508 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874294+0000", 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00013692199999999999 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874702+0000", 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00040793600000000002 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880366+0000", 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0056640220000000003 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882008+0000", 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0016421509999999999 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882080+0000", 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1493000000000001e-05 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882137+0000", 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7380999999999998e-05 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.944 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 94.987841364000005, 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:05.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:05.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:05.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:05.948 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:05.949 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:05.950 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:05.966+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:05.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:06.051 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.068+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2420 4.24 4:25150063:::10000000b94.00000000:head [write 0~670 in=670b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.084845+0000", 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00081477600000000002, 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083652100000000001, 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2420 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084845+0000", 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084845+0000", 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084845+0000", 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000005e-07 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084848+0000", 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059999999999999e-06 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084855+0000", 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0890000000000002e-06 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084861+0000", 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1430000000000003e-06 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084904+0000", 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2889000000000002e-05 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.084975+0000", 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1229000000000005e-05 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085053+0000", 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7692000000000001e-05 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085684+0000", 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063139900000000004 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2421 4.12 4:4bd1d8b8:::10000000b95.00000000:head [write 0~6241 in=6241b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.085664+0000", 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4294967295.9999957, 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4975000000000005e-05, 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2421 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085664+0000", 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085664+0000", 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085664+0000", 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7999999999999995e-07 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085672+0000", 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4739999999999999e-06 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085681+0000", 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6740000000000003e-06 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085688+0000", 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0090000000000001e-06 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.085724+0000", 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6297999999999997e-05 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-15T23:33:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 2 2024-04-15T23:33:06.077 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:06.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:06.162 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.179+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.244 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:06.244 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:06.245 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:06.245 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:06.245 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:06.253 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.270+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.254 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:06.354 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.370+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.412 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:06.412 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4147.0:206 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'152, mlcod=10'145)", 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.999700536000006, 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085079370000000001, 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428513+0000", 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428514+0000", 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428558+0000", 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3667000000000001e-05 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428567+0000", 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.815e-06 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.428572+0000", 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6999999999999999e-06 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430948+0000", 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023760449999999998 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.430959+0000", 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0838e-05 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.436983+0000", 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060244679999999998 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:26.437021+0000", 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7832e-05 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.560135963999997, 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:06.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.422 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.560079220000006, 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:06.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559968064000003, 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:06.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:06.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:06.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559881050000001, 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:06.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:06.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:06.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:06.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559847348999995, 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:06.438 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:06.443 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559658810000002, 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559614592000003, 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:06.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:06.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:06.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559574092999995, 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.559532383000004, 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:06.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:33:06.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:33:06.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.2239353890000002, 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.466 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:1843 4.4 4:23ccaa4b:::10000000952.00000000:head [write 0~1651] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.632060+0000", 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.79615365800000004, 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084044629999999992, 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1843 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632060+0000", 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632060+0000", 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632061+0000", 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8999999999999997e-07 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632063+0000", 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7580000000000001e-06 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632070+0000", 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.246e-06 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632075+0000", 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3290000000000001e-06 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632115+0000", 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9941999999999998e-05 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.632188+0000", 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2583000000000006e-05 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.640340+0000", 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0081524089999999994 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.640379+0000", 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8782000000000002e-05 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.640465+0000", 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5923999999999999e-05 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2168 4.19 4:9a812878:::10000000a98.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:06.471 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.53686206599999997, 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088087919999999993, 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2168 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891355+0000", 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.96e-06 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891362+0000", 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0219999999999999e-06 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891368+0000", 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4310000000000002e-06 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891429+0000", 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1450000000000003e-05 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891541+0000", 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011129300000000001 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900052+0000", 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085109839999999992 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900100+0000", 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8658000000000001e-05 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900161+0000", 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0421999999999998e-05 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2172 4.2f 4:f6501a55:::10000000a9c.00000000:head [write 0~157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:06.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.53384743800000001, 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089697920000000007, 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2172 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894367+0000", 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.92e-07 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894371+0000", 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6049999999999998e-06 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894381+0000", 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0006e-05 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894387+0000", 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6159999999999998e-06 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894469+0000", 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1057999999999995e-05 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894550+0000", 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1829999999999994e-05 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903112+0000", 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085618949999999999 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903259+0000", 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146618 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903336+0000", 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7372000000000004e-05 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2338 4.2e 4:75debd25:::10000000b42.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:06.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.40685503899999997, 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086915159999999998, 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2338 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:06.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4000000000000001e-07 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021362+0000", 2024-04-15T23:33:06.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9670000000000001e-06 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021369+0000", 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1999999999999999e-06 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021373+0000", 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8550000000000004e-06 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021446+0000", 2024-04-15T23:33:06.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3533000000000002e-05 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021524+0000", 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7904999999999994e-05 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.029919+0000", 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083953320000000001 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.029970+0000", 2024-04-15T23:33:06.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0560999999999999e-05 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.030050+0000", 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0523000000000001e-05 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2613 4.15 4:a8a9d09d:::10000000c55.00000000:head [write 0~1560] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.232502+0000", 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.195711724, 2024-04-15T23:33:06.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087723520000000006, 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2613 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232502+0000", 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232502+0000", 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232503+0000", 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.33e-07 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232509+0000", 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4389999999999999e-06 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232520+0000", 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1141999999999999e-05 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232527+0000", 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1799999999999999e-06 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232582+0000", 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5386000000000001e-05 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232663+0000", 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0842999999999998e-05 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.241148+0000", 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084849090000000005 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.241199+0000", 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1461000000000001e-05 2024-04-15T23:33:06.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.241275+0000", 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5059000000000001e-05 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2673 4.34 4:2d3579f9:::10000000c93.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.148321288, 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010159072, 2024-04-15T23:33:06.491 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2673 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279894+0000", 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.827e-06 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279904+0000", 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.696e-06 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279929+0000", 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4973e-05 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279934+0000", 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7790000000000003e-06 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280002+0000", 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8471000000000002e-05 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280096+0000", 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3795999999999994e-05 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280171+0000", 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4898e-05 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280701+0000", 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00052972499999999999 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.289989+0000", 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092879680000000006 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290030+0000", 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1428999999999999e-05 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290052+0000", 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1509999999999999e-05 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.496 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2675 4.34 4:2d414fef:::10000000c95.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.281392+0000", 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.146822021, 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087305230000000004, 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2675 2024-04-15T23:33:06.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281392+0000", 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281392+0000", 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281393+0000", 2024-04-15T23:33:06.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1900000000000002e-07 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281396+0000", 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6279999999999998e-06 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281404+0000", 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8310000000000001e-06 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281409+0000", 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5499999999999996e-06 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281446+0000", 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7055999999999999e-05 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281514+0000", 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7903000000000004e-05 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281583+0000", 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9939999999999998e-05 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.286706+0000", 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051227369999999996 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290078+0000", 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033721129999999999 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290104+0000", 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5259999999999999e-05 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290122+0000", 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8785999999999999e-05 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2836 4.9 4:90ad9b5d:::10000000d37.00000000:head [write 0~3722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.017348535000000002, 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091544030000000002, 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2836 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410866+0000", 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000002e-07 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410869+0000", 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5980000000000001e-06 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410877+0000", 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2640000000000002e-06 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410883+0000", 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1469999999999998e-06 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410925+0000", 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1767999999999997e-05 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411000+0000", 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5216999999999995e-05 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411079+0000", 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8648999999999999e-05 2024-04-15T23:33:06.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411820+0000", 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074130400000000003 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419873+0000", 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080529269999999997 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419923+0000", 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9781999999999999e-05 2024-04-15T23:33:06.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.420020+0000", 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7213999999999995e-05 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2837 4.1f 4:fba2f2aa:::10000000d38.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.411596+0000", 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.016617663000000001, 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083586730000000005, 2024-04-15T23:33:06.508 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2837 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411596+0000", 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411596+0000", 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411597+0000", 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4000000000000001e-07 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411601+0000", 2024-04-15T23:33:06.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6770000000000001e-06 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411611+0000", 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0074999999999999e-05 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411618+0000", 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411667+0000", 2024-04-15T23:33:06.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8599e-05 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411735+0000", 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7922999999999993e-05 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411805+0000", 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0104999999999994e-05 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.412751+0000", 2024-04-15T23:33:06.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094591599999999999 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419861+0000", 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071102220000000002 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419914+0000", 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3179e-05 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419955+0000", 2024-04-15T23:33:06.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0762e-05 2024-04-15T23:33:06.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:06.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:06.514 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:06.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:06.516 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.532+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.616 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.633+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.643 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:06.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:06.643 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.643 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:3116 4.18 4:19bac30c:::10000000e54.00000000:head [write 0~2535 in=2535b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.643 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.655573+0000", 2024-04-15T23:33:06.643 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0048779009999999996, 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0048950139999999996, 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3116 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655573+0000", 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.644 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655573+0000", 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655574+0000", 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8199999999999998e-07 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655578+0000", 2024-04-15T23:33:06.645 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7779999999999998e-06 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655589+0000", 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0497e-05 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655596+0000", 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9949999999999999e-06 2024-04-15T23:33:06.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655630+0000", 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4391000000000003e-05 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.655693+0000", 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2446000000000005e-05 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.647 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4525.0:3117 4.1d e45/13 4:b9279ceb:::10000000e55.00000000:head v 45'49, mlcod=45'47)", 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.656690+0000", 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0037608680000000001, 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0038161110000000001, 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656690+0000", 2024-04-15T23:33:06.648 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656690+0000", 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656690+0000", 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0999999999999998e-07 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.649 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656695+0000", 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2309999999999998e-06 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656704+0000", 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2490000000000007e-06 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656709+0000", 2024-04-15T23:33:06.650 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7180000000000004e-06 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656745+0000", 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6270999999999999e-05 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.656757+0000", 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1936999999999999e-05 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.651 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:3118 4.30 4:0d4b8555:::10000000e56.00000000:head [write 0~2370 in=2370b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.657197+0000", 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0032541470000000002, 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0033398479999999999, 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:06.652 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3118 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657197+0000", 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657197+0000", 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.653 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657197+0000", 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6599999999999995e-07 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657202+0000", 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2390000000000004e-06 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657212+0000", 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0545e-05 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.654 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657217+0000", 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1830000000000002e-06 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657256+0000", 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8843000000000001e-05 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657324+0000", 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7481e-05 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.655 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:3119 4.31 4:8f59b71b:::10000000e57.00000000:head [write 0~222 in=222b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.657925+0000", 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0025253950000000002, 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0026434779999999999, 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "waiting for sub ops", 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.656 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3119 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657925+0000", 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657925+0000", 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.657 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657926+0000", 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.2999999999999999e-07 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657931+0000", 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.685e-06 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.658 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657953+0000", 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2473999999999999e-05 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.657961+0000", 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3989999999999998e-06 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.659 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658005+0000", 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4073000000000003e-05 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.660 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658070+0000", 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5087999999999998e-05 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658143+0000", 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3149e-05 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.661 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:3120 4.a 4:5310b1e0:::10000000e58.00000000:head [write 0~2545 in=2545b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.658677+0000", 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.00177359, 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001927488, 2024-04-15T23:33:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3120 2024-04-15T23:33:06.663 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.664 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.664 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.664 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.664 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658677+0000", 2024-04-15T23:33:06.664 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658677+0000", 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.665 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658678+0000", 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8400000000000003e-07 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658682+0000", 2024-04-15T23:33:06.666 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0779999999999997e-06 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658693+0000", 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.06e-05 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.667 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658698+0000", 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1989999999999997e-06 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658744+0000", 2024-04-15T23:33:06.668 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6400000000000003e-05 2024-04-15T23:33:06.669 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.669 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.669 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.669 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.658819+0000", 2024-04-15T23:33:06.669 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4777999999999995e-05 2024-04-15T23:33:06.669 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.670 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.670 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.670 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.670 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:3121 4.3d 4:bfaf3311:::10000000e59.00000000:head [write 0~222 in=222b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:06.670 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.659418+0000", 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.001032701, 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0012315259999999999, 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "waiting for sub ops", 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:06.671 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 3121 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659418+0000", 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659418+0000", 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.672 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659419+0000", 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6199999999999997e-07 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659423+0000", 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9960000000000004e-06 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659433+0000", 2024-04-15T23:33:06.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0541e-05 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659439+0000", 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2249999999999999e-06 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659505+0000", 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6415999999999996e-05 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.674 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659572+0000", 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6828000000000005e-05 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.659639+0000", 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7391000000000006e-05 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 6 2024-04-15T23:33:06.675 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:06.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:06.717 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.734+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.796 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:06.796 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:06.796 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:06.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:06.818 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.834+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.919 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:06.936+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:06.922 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:06.922 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.868342333, 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.923 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.924 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.925 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:06.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:06.927 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.86826084499999, 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.928 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:06.931 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:06.932 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:06.933 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.070169153999998, 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.934 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.935 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.936 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.937 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:06.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.070121164, 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.940 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:06.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:06.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:06.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.070082865000003, 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.946 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:06.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:06.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:06.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.070044077000006, 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:06.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.070020745999997, 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.957 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:06.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069990261000001, 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:06.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:06.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069955191999995, 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.968 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:06.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069931448999995, 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:06.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:06.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:06.978 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069878850999999, 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:06.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:06.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:06.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:06.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069840052000004, 2024-04-15T23:33:06.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:06.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:06.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069804880999996, 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:06.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:06.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069771513000006, 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:06.995 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:06.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:06.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.069714051999995, 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:07.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:07.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.068078392000004, 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.006 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:07.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:07.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:07.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.067186860000007, 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:07.011 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.016 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 96.067097395999994, 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:07.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:07.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:07.020 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.660156886, 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:07.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:07.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:07.025 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.65942153599999997, 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:07.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:07.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:07.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:07.030 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:07.032 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.048+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:07.033 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:07.132 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.149+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:07.152 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:07.152 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:07.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.152 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3762 4.33 4:cda8d3bb:::100000010da.00000000:head [write 0~805 in=805b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.152 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.165911+0000", 2024-04-15T23:33:07.152 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0037579419999999998, 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003774711, 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3762 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.165911+0000", 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.165911+0000", 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.165912+0000", 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5899999999999995e-07 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.165916+0000", 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0400000000000003e-06 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.165929+0000", 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2261e-05 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.165934+0000", 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3009999999999997e-06 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.166004+0000", 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9865999999999998e-05 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.166091+0000", 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7158999999999997e-05 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.156 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3764 4.1f 4:f90aee67:::100000010dc.00000000:head [write 0~1652 in=1652b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.167387+0000", 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0022827379999999999, 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002344226, 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3764 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167387+0000", 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167387+0000", 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167388+0000", 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7400000000000002e-07 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167392+0000", 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1960000000000001e-06 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167402+0000", 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0392e-05 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167408+0000", 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5570000000000003e-06 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167476+0000", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8021000000000005e-05 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167543+0000", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7649000000000002e-05 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.167608+0000", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4976999999999998e-05 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168480+0000", 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087118999999999999 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3765 4.28 4:14b74276:::100000010dd.00000000:head [write 0~113 in=113b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.168034+0000", 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.001635533, 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017406909999999999, 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.161 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3765 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168034+0000", 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168034+0000", 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168035+0000", 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6499999999999999e-07 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168037+0000", 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.824e-06 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168044+0000", 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6640000000000001e-06 2024-04-15T23:33:07.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168048+0000", 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9519999999999996e-06 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168082+0000", 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4322000000000001e-05 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168148+0000", 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5312000000000001e-05 2024-04-15T23:33:07.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3766 4.1 4:83547236:::100000010de.00000000:head [write 0~2957 in=2957b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.168793+0000", 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00087625500000000005, 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010176219999999999, 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3766 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168793+0000", 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168793+0000", 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168794+0000", 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.018e-06 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168800+0000", 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4790000000000004e-06 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168811+0000", 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1429e-05 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168817+0000", 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2389999999999999e-06 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168865+0000", 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7723999999999999e-05 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.168934+0000", 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8579999999999997e-05 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169001+0000", 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7064999999999996e-05 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3767 4.4 4:22111d42:::100000010df.00000000:head [write 0~44 in=44b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.169481+0000", 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00018804800000000001, 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000370317, 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:07.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3767 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169481+0000", 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169481+0000", 2024-04-15T23:33:07.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169482+0000", 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8000000000000005e-07 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169486+0000", 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5489999999999998e-06 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169494+0000", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5399999999999996e-06 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169499+0000", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6140000000000002e-06 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169543+0000", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4175999999999999e-05 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.169657+0000", 2024-04-15T23:33:07.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113749 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 5 2024-04-15T23:33:07.173 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:07.174 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:07.234 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.251+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:07.290 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:07.290 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:07.290 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:07.290 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:07.291 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:07.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:07.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:33:07.335 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.352+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:07.418 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:07.418 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565741720999995, 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:07.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:07.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565684977000004, 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:07.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:07.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565573821000001, 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:07.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565486806999999, 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:07.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:07.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565453106000007, 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:07.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:07.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:07.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565264567, 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.449 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565220349000001, 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.455 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:07.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565179850000007, 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:07.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.565138140000002, 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:07.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:33:07.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:07.470 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.2295411459999999, 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:07.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2168 4.19 4:9a812878:::10000000a98.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.542467823, 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088087919999999993, 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2168 2024-04-15T23:33:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891355+0000", 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.96e-06 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891362+0000", 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0219999999999999e-06 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891368+0000", 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4310000000000002e-06 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891429+0000", 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1450000000000003e-05 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891541+0000", 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011129300000000001 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900052+0000", 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085109839999999992 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900100+0000", 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8658000000000001e-05 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900161+0000", 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0421999999999998e-05 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2172 4.2f 4:f6501a55:::10000000a9c.00000000:head [write 0~157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.5394531950000001, 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089697920000000007, 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2172 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894367+0000", 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.92e-07 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894371+0000", 2024-04-15T23:33:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6049999999999998e-06 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894381+0000", 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0006e-05 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894387+0000", 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6159999999999998e-06 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894469+0000", 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1057999999999995e-05 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894550+0000", 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1829999999999994e-05 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903112+0000", 2024-04-15T23:33:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085618949999999999 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903259+0000", 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146618 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903336+0000", 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7372000000000004e-05 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2338 4.2e 4:75debd25:::10000000b42.00000000:head [write 0~1345] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.412460796, 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086915159999999998, 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2338 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021359+0000", 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4000000000000001e-07 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021362+0000", 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9670000000000001e-06 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021369+0000", 2024-04-15T23:33:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1999999999999999e-06 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021373+0000", 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8550000000000004e-06 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021446+0000", 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3533000000000002e-05 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.021524+0000", 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7904999999999994e-05 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.029919+0000", 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083953320000000001 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.029970+0000", 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0560999999999999e-05 2024-04-15T23:33:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.030050+0000", 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0523000000000001e-05 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2613 4.15 4:a8a9d09d:::10000000c55.00000000:head [write 0~1560] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.232502+0000", 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.201317481, 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087723520000000006, 2024-04-15T23:33:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2613 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232502+0000", 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232502+0000", 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232503+0000", 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.33e-07 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232509+0000", 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4389999999999999e-06 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232520+0000", 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1141999999999999e-05 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232527+0000", 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1799999999999999e-06 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232582+0000", 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5386000000000001e-05 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.232663+0000", 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0842999999999998e-05 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.241148+0000", 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084849090000000005 2024-04-15T23:33:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.241199+0000", 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1461000000000001e-05 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.241275+0000", 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5059000000000001e-05 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2673 4.34 4:2d3579f9:::10000000c93.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1539270450000001, 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010159072, 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2673 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279894+0000", 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.827e-06 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279904+0000", 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.696e-06 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279929+0000", 2024-04-15T23:33:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4973e-05 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279934+0000", 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7790000000000003e-06 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280002+0000", 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8471000000000002e-05 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280096+0000", 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3795999999999994e-05 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280171+0000", 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4898e-05 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280701+0000", 2024-04-15T23:33:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00052972499999999999 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.289989+0000", 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092879680000000006 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290030+0000", 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1428999999999999e-05 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290052+0000", 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1509999999999999e-05 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2675 4.34 4:2d414fef:::10000000c95.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.281392+0000", 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1524277780000001, 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087305230000000004, 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2675 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281392+0000", 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281392+0000", 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281393+0000", 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1900000000000002e-07 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281396+0000", 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6279999999999998e-06 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281404+0000", 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8310000000000001e-06 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281409+0000", 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5499999999999996e-06 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281446+0000", 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7055999999999999e-05 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281514+0000", 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7903000000000004e-05 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.281583+0000", 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9939999999999998e-05 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.286706+0000", 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051227369999999996 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290078+0000", 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033721129999999999 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290104+0000", 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5259999999999999e-05 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290122+0000", 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8785999999999999e-05 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2836 4.9 4:90ad9b5d:::10000000d37.00000000:head [write 0~3722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.0229542920000001, 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091544030000000002, 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2836 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410866+0000", 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000002e-07 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410869+0000", 2024-04-15T23:33:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5980000000000001e-06 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410877+0000", 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2640000000000002e-06 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410883+0000", 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1469999999999998e-06 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410925+0000", 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1767999999999997e-05 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411000+0000", 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5216999999999995e-05 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411079+0000", 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8648999999999999e-05 2024-04-15T23:33:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411820+0000", 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074130400000000003 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419873+0000", 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080529269999999997 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419923+0000", 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9781999999999999e-05 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.420020+0000", 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7213999999999995e-05 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2871 4.33 4:ced46a01:::10000000d5a.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.438166+0000", 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.99565368499999995, 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089059229999999996, 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2871 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438166+0000", 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438166+0000", 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438167+0000", 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438170+0000", 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.721e-06 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438178+0000", 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9889999999999992e-06 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438183+0000", 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8720000000000001e-06 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438231+0000", 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7354000000000001e-05 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438304+0000", 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3813000000000006e-05 2024-04-15T23:33:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.446986+0000", 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086817820000000007 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.447022+0000", 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6062000000000001e-05 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.447072+0000", 2024-04-15T23:33:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9586999999999998e-05 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 4.2e 4:7611a124:::1000000021e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.910616+0000", 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.52320343199999997, 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092266369999999993, 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910616+0000", 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910616+0000", 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910617+0000", 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2099999999999996e-07 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910620+0000", 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8490000000000002e-06 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910628+0000", 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4109999999999996e-06 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910634+0000", 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.964e-06 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910680+0000", 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5781000000000001e-05 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910760+0000", 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0313000000000002e-05 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.919754+0000", 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089936249999999999 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.919802+0000", 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8424999999999998e-05 2024-04-15T23:33:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.919843+0000", 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0547999999999999e-05 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3814 4.36 4:6f41bf00:::1000000110e.00000000:head [write 0~2125] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.204943+0000", 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22887633099999999, 2024-04-15T23:33:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088566210000000003, 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3814 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204943+0000", 2024-04-15T23:33:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204943+0000", 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204944+0000", 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9400000000000004e-07 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204949+0000", 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.544e-06 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204957+0000", 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5140000000000001e-06 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204962+0000", 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.205018+0000", 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5797999999999997e-05 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.205093+0000", 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4678000000000006e-05 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.213725+0000", 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086326279999999998 2024-04-15T23:33:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.213753+0000", 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.213800+0000", 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6480000000000002e-05 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:07.533 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:07.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:07.535 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.550+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:07.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:07.635 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:07.652+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:07.639 INFO:tasks.workunit.client.0.smithi102.stderr:Updating files: 28% (1214/4290) Updating files: 29% (1245/4290) Updating files: 30% (1287/4290) Updating files: 31% (1330/4290) Updating files: 32% (1373/4290) Updating files: 33% (1416/4290) Updating files: 34% (1459/4290) Updating files: 35% (1502/4290) Updating files: 36% (1545/4290) Updating files: 37% (1588/4290) Updating files: 38% (1631/4290) Updating files: 39% (1674/4290) Updating files: 40% (1716/4290) Updating files: 41% (1759/4290) Updating files: 42% (1802/4290) Updating files: 43% (1845/4290) Updating files: 44% (1888/4290) Updating files: 45% (1931/4290) Updating files: 46% (1974/4290) Updating files: 47% (2017/4290) Updating files: 48% (2060/4290) Updating files: 49% (2103/4290) Updating files: 50% (2145/4290) Updating files: 51% (2188/4290) Updating files: 52% (2231/4290) Updating files: 53% (2274/4290) Updating files: 54% (2317/4290) Updating files: 55% (2360/4290) Updating files: 56% (2403/4290) Updating files: 57% (2446/4290) Updating files: 57% (2454/4290) Updating files: 58% (2489/4290) Updating files: 59% (2532/4290) Updating files: 60% (2574/4290) Updating files: 61% (2617/4290) Updating files: 62% (2660/4290) Updating files: 63% (2703/4290) Updating files: 64% (2746/4290) Updating files: 65% (2789/4290) Updating files: 66% (2832/4290) Updating files: 67% (2875/4290) Updating files: 68% (2918/4290) Updating files: 69% (2961/4290) Updating files: 70% (3003/4290) Updating files: 71% (3046/4290) Updating files: 72% (3089/4290) Updating files: 73% (3132/4290) Updating files: 74% (3175/4290) Updating files: 75% (3218/4290) Updating files: 76% (3261/4290) Updating files: 77% (3304/4290) Updating files: 78% (3347/4290) Updating files: 79% (3390/4290) Updating files: 80% (3432/4290) Updating files: 81% (3475/4290) Updating files: 82% (3518/4290) Updating files: 83% (3561/4290) Updating files: 84% (3604/4290) Updating files: 85% (3647/4290) Updating files: 85% (3689/4290) Updating files: 86% (3690/4290) Updating files: 87% (3733/4290) Updating files: 88% (3776/4290) Updating files: 89% (3819/4290) Updating files: 90% (3861/4290) Updating files: 91% (3904/4290) Updating files: 92% (3947/4290) Updating files: 93% (3990/4290) Updating files: 94% (4033/4290) Updating files: 95% (4076/4290) Updating files: 96% (4119/4290) Updating files: 97% (4162/4290) Updating files: 98% (4205/4290) Updating files: 99% (4248/4290) Updating files: 100% (4290/4290) Updating files: 100% (4290/4290), done. 2024-04-15T23:33:07.649 INFO:tasks.workunit.client.0.smithi102.stderr:+ cd xfstests-dev 2024-04-15T23:33:07.650 INFO:tasks.workunit.client.0.smithi102.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-04-15T23:33:07.651 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:07.651 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:07.651 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:07.651 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:07.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:07.679 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:07.680 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:07.708 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:07.708 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:07.708 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:07.712 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:07.713 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:07.736 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.753+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:07.768 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:07.768 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:07.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:07.837 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:07.854+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:07.927 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:07.927 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:07.936 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:07.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-04-15T23:33:07.938 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:07.955+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.039 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:08.055+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.046 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.046 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:08.140 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:08.156+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.163 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.163 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:08.241 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:08.258+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.279 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.280 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:08.313 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:33:08.341 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:08.358+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:08.400 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.400 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:08.452 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:08.469+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.516 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.517 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:08.566 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:08.583+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.644 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:08.661+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:08.674 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.674 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.683 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:08.745 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:08.762+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:08.793 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.793 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:08.886 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:08.903+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:08.947 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:08.963+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:08.950 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:08.950 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:08.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:09.048 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.065+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.107 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:09.108 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:09.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:09.158 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.174+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.241 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:09.241 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:09.250 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.266+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:09.351 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.367+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.368 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:09.368 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:09.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:09.454 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:09.469+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:09.496 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:09.496 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:09.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:09.552 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.569+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.619 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:09.619 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:09.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:09.669 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.686+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:09.753 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:09.770+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:09.787 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:09.787 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:09.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:09.854 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:09.870+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:09.858 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:09.859 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:09.882 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:09.883 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:09.883 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:09.885 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:09.886 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:09.954 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:09.971+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109909486999996, 2024-04-15T23:33:09.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:09.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109852743000005, 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:09.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109741587000002, 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:09.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:09.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109654573, 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:09.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109620871999994, 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.984 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109432333000001, 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:33:09.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109388115000002, 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:09.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:09.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:09.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:09.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109347615999994, 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.004 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.109305906000003, 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094562380000000005, 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868682+0000", 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6899999999999997e-07 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868685+0000", 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4039999999999999e-06 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868694+0000", 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0059999999999998e-06 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868701+0000", 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6919999999999996e-06 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868749+0000", 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8136999999999997e-05 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868826+0000", 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7099000000000002e-05 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878138+0000", 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093113310000000008 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:10.008 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.773708912, 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:10.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2168 4.19 4:9a812878:::10000000a98.00000000:head [write 0~276] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.013 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0866355890000001, 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088087919999999993, 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2168 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:10.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891352+0000", 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7199999999999999e-07 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891355+0000", 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.96e-06 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891362+0000", 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0219999999999999e-06 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891368+0000", 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4310000000000002e-06 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891429+0000", 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1450000000000003e-05 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.891541+0000", 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011129300000000001 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900052+0000", 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085109839999999992 2024-04-15T23:33:10.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900100+0000", 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8658000000000001e-05 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.900161+0000", 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0421999999999998e-05 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2172 4.2f 4:f6501a55:::10000000a9c.00000000:head [write 0~157] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0836209610000003, 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089697920000000007, 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2172 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894366+0000", 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894367+0000", 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.92e-07 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894371+0000", 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6049999999999998e-06 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894381+0000", 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0006e-05 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894387+0000", 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6159999999999998e-06 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894469+0000", 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1057999999999995e-05 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.894550+0000", 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1829999999999994e-05 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903112+0000", 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085618949999999999 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903259+0000", 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146618 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:05.903336+0000", 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7372000000000004e-05 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2673 4.34 4:2d3579f9:::10000000c93.00000000:head [write 0~1610] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.023 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.6980948109999998, 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010159072, 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2673 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:10.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279893+0000", 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279894+0000", 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.827e-06 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279904+0000", 2024-04-15T23:33:10.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.696e-06 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279929+0000", 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4973e-05 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.279934+0000", 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7790000000000003e-06 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280002+0000", 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8471000000000002e-05 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280096+0000", 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3795999999999994e-05 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280171+0000", 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4898e-05 2024-04-15T23:33:10.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.280701+0000", 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00052972499999999999 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.289989+0000", 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092879680000000006 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290030+0000", 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1428999999999999e-05 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.290052+0000", 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1509999999999999e-05 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2836 4.9 4:90ad9b5d:::10000000d37.00000000:head [write 0~3722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.5671220579999998, 2024-04-15T23:33:10.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091544030000000002, 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2836 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410865+0000", 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410866+0000", 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000002e-07 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410869+0000", 2024-04-15T23:33:10.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5980000000000001e-06 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410877+0000", 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2640000000000002e-06 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410883+0000", 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1469999999999998e-06 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.410925+0000", 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1767999999999997e-05 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411000+0000", 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5216999999999995e-05 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411079+0000", 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8648999999999999e-05 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.411820+0000", 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074130400000000003 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419873+0000", 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080529269999999997 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.419923+0000", 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9781999999999999e-05 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.420020+0000", 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7213999999999995e-05 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:2871 4.33 4:ced46a01:::10000000d5a.00000000:head [write 0~43] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.438166+0000", 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.5398214509999999, 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089059229999999996, 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.035 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2871 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438166+0000", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438166+0000", 2024-04-15T23:33:10.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438167+0000", 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438170+0000", 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.721e-06 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438178+0000", 2024-04-15T23:33:10.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9889999999999992e-06 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438183+0000", 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8720000000000001e-06 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438231+0000", 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7354000000000001e-05 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.438304+0000", 2024-04-15T23:33:10.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3813000000000006e-05 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.446986+0000", 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086817820000000007 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.447022+0000", 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6062000000000001e-05 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.447072+0000", 2024-04-15T23:33:10.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9586999999999998e-05 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:115 4.2e 4:7611a124:::1000000021e.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e45)", 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:06.910616+0000", 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.067371198, 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092266369999999993, 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910616+0000", 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910616+0000", 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910617+0000", 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2099999999999996e-07 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910620+0000", 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8490000000000002e-06 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910628+0000", 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4109999999999996e-06 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910634+0000", 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.964e-06 2024-04-15T23:33:10.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910680+0000", 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5781000000000001e-05 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.910760+0000", 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0313000000000002e-05 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.919754+0000", 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089936249999999999 2024-04-15T23:33:10.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.919802+0000", 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8424999999999998e-05 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:06.919843+0000", 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0547999999999999e-05 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:3814 4.36 4:6f41bf00:::1000000110e.00000000:head [write 0~2125] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.204943+0000", 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.7730440970000001, 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088566210000000003, 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3814 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204943+0000", 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204943+0000", 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204944+0000", 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9400000000000004e-07 2024-04-15T23:33:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204949+0000", 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.544e-06 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204957+0000", 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5140000000000001e-06 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.204962+0000", 2024-04-15T23:33:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.205018+0000", 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5797999999999997e-05 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.205093+0000", 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4678000000000006e-05 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.213725+0000", 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086326279999999998 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.213753+0000", 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.213800+0000", 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6480000000000002e-05 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.4455949590000001, 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4201 4.28 4:14d9ac9d:::10000001291.00000000:head [write 0~81] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.4447587089999998, 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010640775, 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4201 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533231+0000", 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.844e-06 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533240+0000", 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4460000000000007e-06 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533268+0000", 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7599000000000001e-05 2024-04-15T23:33:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533290+0000", 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1923999999999999e-05 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533905+0000", 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061543500000000001 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533973+0000", 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8430999999999996e-05 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543770+0000", 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097962780000000003 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543808+0000", 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8009000000000001e-05 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543869+0000", 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1809000000000004e-05 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4203 4.14 4:2bb75041:::10000001293.00000000:head [write 0~83] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.534726+0000", 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.4432619039999999, 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091055340000000002, 2024-04-15T23:33:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4203 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534726+0000", 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534726+0000", 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534726+0000", 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534730+0000", 2024-04-15T23:33:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8530000000000002e-06 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534741+0000", 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.048e-05 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534746+0000", 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1399999999999999e-06 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534781+0000", 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5080999999999998e-05 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.534849+0000", 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8572999999999996e-05 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543717+0000", 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088677740000000001 2024-04-15T23:33:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543762+0000", 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5163000000000001e-05 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543831+0000", 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8726999999999994e-05 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.066 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:10.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:10.071 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.083+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.167 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.184+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:5123 4.31 4:8df432d9:::1000000163c.00000000:head [write 0~1073 in=1073b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:10.198866+0000", 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.002731242, 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0027546799999999998, 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.184 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "waiting for sub ops", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 5123 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198866+0000", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198866+0000", 2024-04-15T23:33:10.185 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198867+0000", 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.5799999999999999e-07 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198870+0000", 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9859999999999999e-06 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.186 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198877+0000", 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2740000000000002e-06 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198882+0000", 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5889999999999996e-06 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198918+0000", 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6457e-05 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.187 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.198995+0000", 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6783e-05 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.199066+0000", 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0593000000000007e-05 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.199692+0000", 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062675299999999997 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.188 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4525.0:5125 4.2 e46/13 4:423a151f:::1000000163e.00000000:head v 46'86, mlcod=46'84)", 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:10.201560+0000", 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 3.7923000000000003e-05, 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014506299999999999, 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.189 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201560+0000", 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201560+0000", 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201560+0000", 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5300000000000004e-07 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.190 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201565+0000", 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0529999999999997e-06 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201575+0000", 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.9280000000000005e-06 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201580+0000", 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0189999999999997e-06 2024-04-15T23:33:10.191 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201626+0000", 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.5580000000000001e-05 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:10.201647+0000", 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0605e-05 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-15T23:33:10.192 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 2 2024-04-15T23:33:10.193 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:10.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:10.278 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.295+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.329 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:33:10.348 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:10.349 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:10.349 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:10.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:10.399 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.416+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.470 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:10.486+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.45997549800001, 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.514 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.515 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.516 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.517 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.518 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.519 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.45989401, 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.520 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:10.521 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:10.522 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:10.523 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:10.524 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661802319000003, 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.525 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.526 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:10.530 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661754329000004, 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:10.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:10.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:10.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661716029999994, 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:10.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:10.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661677241999996, 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661653911000002, 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.546 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:10.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:10.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:10.551 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661623426000006, 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:10.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:10.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:10.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661588356999999, 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.561 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661564614, 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661512016000003, 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.567 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:10.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:10.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661473216999994, 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.572 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:10.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661438046000001, 2024-04-15T23:33:10.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:10.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:10.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:10.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.582 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661404677999997, 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:10.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:10.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.587 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.661347216999999, 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.588 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:10.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:10.593 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.659711556999994, 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:10.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:10.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:10.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:10.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.658820024999997, 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:10.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:10.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:10.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:10.603 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 99.658730560999999, 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.607 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.2517900510000004, 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.608 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:10.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:10.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:10.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 4.2510547010000002, 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:10.617 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:10.619 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.635+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:10.719 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.736+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.742 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:10.742 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:10.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.742 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:5521 4.1c 4:3a88e80d:::100000017c9.00000000:head [write 0~6070 in=6070b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.759552+0000", 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00055872799999999998, 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057579199999999999, 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 5521 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759552+0000", 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759552+0000", 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759553+0000", 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7800000000000001e-07 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759564+0000", 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1133e-05 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759575+0000", 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.066e-05 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759580+0000", 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1070000000000004e-06 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759624+0000", 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4391999999999998e-05 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.759700+0000", 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5630000000000006e-05 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-15T23:33:10.746 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-15T23:33:10.747 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:10.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:10.820 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:10.837+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:10.865 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:10.865 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:10.866 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:10.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:10.921 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:10.937+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:11.017 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:11.017 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:11.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.165223213, 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:11.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:11.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:11.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.165166469, 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:11.023 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:11.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:11.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.028 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.165055313, 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:11.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:11.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.16496829899999, 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.034 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:11.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.039 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.164934598, 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:11.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:11.044 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.164746059, 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452698999999999, 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868555+0000", 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868556+0000", 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0699999999999996e-07 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868562+0000", 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3849999999999999e-06 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868574+0000", 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1291000000000001e-05 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868582+0000", 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9880000000000004e-06 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869181+0000", 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059977100000000003 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869284+0000", 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010289900000000001 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869467+0000", 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000182762 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870215+0000", 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00074833300000000001 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878940+0000", 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087242699999999992 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878979+0000", 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9665000000000001e-05 2024-04-15T23:33:11.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879008+0000", 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8527999999999999e-05 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.164701841, 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.050 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.164661342, 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:11.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.8290226379999996, 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.064 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.5009086849999997, 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4201 4.28 4:14d9ac9d:::10000001291.00000000:head [write 0~81] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:11.069 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.5000724349999999, 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010640775, 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4201 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533231+0000", 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.844e-06 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533240+0000", 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4460000000000007e-06 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533268+0000", 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7599000000000001e-05 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533290+0000", 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1923999999999999e-05 2024-04-15T23:33:11.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533905+0000", 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061543500000000001 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533973+0000", 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8430999999999996e-05 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543770+0000", 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097962780000000003 2024-04-15T23:33:11.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543808+0000", 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8009000000000001e-05 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543869+0000", 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1809000000000004e-05 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1370430920000001, 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1327730629999999, 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.079 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:134 3.2 3:4272d415:::200.0000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.1321458129999999, 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010663280000000001, 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:11.084 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901156+0000", 2024-04-15T23:33:11.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901158+0000", 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1040000000000001e-06 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901162+0000", 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8789999999999996e-06 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901165+0000", 2024-04-15T23:33:11.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1499999999999999e-06 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901211+0000", 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6242000000000002e-05 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901318+0000", 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106406 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911819+0000", 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010500979000000001 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.40987160500000003, 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.092 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.34371892100000001, 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:11.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:11.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:11.098 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.343708915, 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:11.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:11.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.34369600300000003, 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.33779801799999998, 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.109 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:11.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:11.114 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.33658890600000002, 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:11.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:11.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.119 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:11.120 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:11.120 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:11.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:11.122 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:11.137+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:11.222 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:11.238+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(client.4525.0:5890 4.34 e46/13 4:2edcfceb:::1000000193a.00000000:head v 46'93, mlcod=46'91)", 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:11.252656+0000", 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.8116999999999996e-05, 2024-04-15T23:33:11.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000112503, 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252656+0000", 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252656+0000", 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252656+0000", 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7399999999999998e-07 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252663+0000", 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.6229999999999999e-06 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252671+0000", 2024-04-15T23:33:11.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7419999999999997e-06 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252677+0000", 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.0870000000000003e-06 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252723+0000", 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6882999999999998e-05 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:11.252739+0000", 2024-04-15T23:33:11.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5048999999999999e-05 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 1 2024-04-15T23:33:11.239 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:11.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:11.319 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:33:11.323 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:11.339+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:11.361 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:11.361 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:11.362 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:11.362 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:11.362 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:11.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:11.455 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:11.472+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:11.524 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:11.541+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:11.525 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:11.525 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:11.525 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.472028048, 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:11.526 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.527 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.528 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:11.529 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.530 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.531 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.47194656000001, 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:11.532 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.533 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.534 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.535 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.536 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.537 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673854869, 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.538 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.539 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:11.541 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:11.542 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673806879, 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:11.543 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.544 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.545 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:11.546 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:11.547 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.548 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67376858, 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.549 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.550 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.551 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.552 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.553 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673729792, 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.554 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.555 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.556 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.557 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.558 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:11.559 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67370646099999, 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.560 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:11.561 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:11.562 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:11.563 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.564 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673675976, 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.565 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:11.566 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:11.568 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:11.569 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:11.570 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67364090700001, 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.571 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:11.572 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:11.573 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:11.574 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.575 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67361716400001, 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.576 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.577 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.578 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.579 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:11.580 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.581 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673564566, 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:11.582 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:11.583 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:11.584 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.585 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.586 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673525767, 2024-04-15T23:33:11.587 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.588 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:11.589 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:11.590 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:11.591 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:11.592 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67349059599999, 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.593 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:11.594 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:11.595 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:11.596 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.597 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.598 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.673457228, 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.599 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:11.600 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:11.601 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.602 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.603 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67339976700001, 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.604 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:11.605 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:11.607 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:11.608 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:11.609 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.671764107, 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.610 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:11.611 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:11.612 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:11.613 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.614 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.670872575, 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.615 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:11.616 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:11.617 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:11.618 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:11.619 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 100.67078311100001, 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.620 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.621 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:11.622 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:11.623 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.2638426010000003, 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:11.624 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.625 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.626 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:11.627 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:11.628 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 5.2631072510000001, 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:11.629 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.630 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.631 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.632 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.633 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.634 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.634 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:11.634 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:11.634 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:11.635 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-04-15T23:33:11.635 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.635 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-15T23:33:11.635 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-04-15T23:33:11.636 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-04-15T23:33:11.637 INFO:tasks.workunit.client.0.smithi102.stderr:+ make -j4 2024-04-15T23:33:11.637 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize -cfi 2024-04-15T23:33:11.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:11.638 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:11.652+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:11.736 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:11.753+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:11.745 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:11.746 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:11.746 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:11.754 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:11.837 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:11.853+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:11.863 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:11.863 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:11.863 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:11.863 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:11.863 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:11.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:11.887 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:11.958 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:11.975+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:12.001 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: putting auxiliary files in '.'. 2024-04-15T23:33:12.001 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file './config.guess' 2024-04-15T23:33:12.026 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:12.030 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file './config.sub' 2024-04-15T23:33:12.036 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file './install-sh' 2024-04-15T23:33:12.039 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:12.056+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:12.044 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file './ltmain.sh' 2024-04-15T23:33:12.045 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:12.045 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:12.046 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:12.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:12.049 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:12.054 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.054 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:12.074 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-04-15T23:33:12.074 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-04-15T23:33:12.081 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-04-15T23:33:12.088 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-04-15T23:33:12.095 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-04-15T23:33:12.101 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-04-15T23:33:12.109 INFO:tasks.workunit.client.0.smithi102.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-04-15T23:33:12.110 INFO:tasks.workunit.client.0.smithi102.stdout:cp include/install-sh . 2024-04-15T23:33:12.117 INFO:tasks.workunit.client.0.smithi102.stdout:aclocal -I m4 2024-04-15T23:33:12.140 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:12.156+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:12.171 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.171 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:12.241 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:12.257+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:12.328 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.328 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:12.381 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:12.398+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:12.442 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:12.459+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:12.445 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.446 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.454 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:12.544 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:12.560+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:12.564 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.564 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.572 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:12.656 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:12.673+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:12.721 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.721 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:12.770 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:12.787+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:12.845 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:12.862+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:12.878 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:12.879 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:12.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:12.947 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:12.963+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.020 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.020 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:13.070 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:13.087+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.147 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:13.164+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.177 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.177 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:13.266 INFO:tasks.workunit.client.0.smithi102.stdout:autoheader 2024-04-15T23:33:13.270 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:13.287+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.335 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.335 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.335 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:33:13.343 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:13.384 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:13.401+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.451 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:13.468+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.452 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.452 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:13.554 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:13.571+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:13.569 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.569 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:13.615 INFO:tasks.workunit.client.0.smithi102.stdout:autoconf 2024-04-15T23:33:13.655 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:13.672+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:13.686 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.686 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:13.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-04-15T23:33:13.757 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:13.773+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:13.802 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.803 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:13.822 INFO:tasks.workunit.client.0.smithi102.stdout:./configure \ 2024-04-15T23:33:13.822 INFO:tasks.workunit.client.0.smithi102.stdout: --libexecdir=/usr/lib \ 2024-04-15T23:33:13.822 INFO:tasks.workunit.client.0.smithi102.stdout: --exec_prefix=/var/lib 2024-04-15T23:33:13.857 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:13.874+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:13.920 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:13.920 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:13.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:13.958 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:13.974+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:13.966 INFO:tasks.workunit.client.0.smithi102.stdout:checking build system type... x86_64-pc-linux-gnu 2024-04-15T23:33:13.966 INFO:tasks.workunit.client.0.smithi102.stdout:checking host system type... x86_64-pc-linux-gnu 2024-04-15T23:33:13.968 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to print strings... printf 2024-04-15T23:33:13.968 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gcc... gcc 2024-04-15T23:33:14.038 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:14.039 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:14.043 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether the C compiler works... yes 2024-04-15T23:33:14.044 INFO:tasks.workunit.client.0.smithi102.stdout:checking for C compiler default output file name... a.out 2024-04-15T23:33:14.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:14.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:14.059 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:14.076+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:14.088 INFO:tasks.workunit.client.0.smithi102.stdout:checking for suffix of executables... 2024-04-15T23:33:14.141 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether we are cross compiling... no 2024-04-15T23:33:14.159 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:14.176+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:14.160 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:14.160 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:14.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:14.173 INFO:tasks.workunit.client.0.smithi102.stdout:checking for suffix of object files... o 2024-04-15T23:33:14.190 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:14.190 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:14.198 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether we are using the GNU C compiler... yes 2024-04-15T23:33:14.210 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:14.211 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:14.214 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:14.215 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:14.222 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether gcc accepts -g... yes 2024-04-15T23:33:14.260 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:14.277+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:14.277 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:14.277 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:14.277 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:14.277 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:14.277 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:14.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:14.297 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-15T23:33:14.300 INFO:tasks.workunit.client.0.smithi102.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-04-15T23:33:14.303 INFO:tasks.workunit.client.0.smithi102.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-15T23:33:14.304 INFO:tasks.workunit.client.0.smithi102.stdout:checking for egrep... /usr/bin/grep -E 2024-04-15T23:33:14.306 INFO:tasks.workunit.client.0.smithi102.stdout:checking for fgrep... /usr/bin/grep -F 2024-04-15T23:33:14.309 INFO:tasks.workunit.client.0.smithi102.stdout:checking for ld used by gcc... /usr/bin/ld 2024-04-15T23:33:14.311 INFO:tasks.workunit.client.0.smithi102.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-04-15T23:33:14.334 INFO:tasks.workunit.client.0.smithi102.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-04-15T23:33:14.340 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:33:14.369 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:14.386+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.58475321900001, 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.584696475, 2024-04-15T23:33:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.584585319, 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.584498305, 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.584464604, 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.584231847, 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 103.584191348, 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.248552644, 2024-04-15T23:33:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.9204386910000002, 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4201 4.28 4:14d9ac9d:::10000001291.00000000:head [write 0~81] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.9196024410000003, 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010640775, 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4201 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533231+0000", 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.844e-06 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533240+0000", 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4460000000000007e-06 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533268+0000", 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7599000000000001e-05 2024-04-15T23:33:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533290+0000", 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1923999999999999e-05 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533905+0000", 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061543500000000001 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533973+0000", 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8430999999999996e-05 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543770+0000", 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097962780000000003 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543808+0000", 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8009000000000001e-05 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543869+0000", 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1809000000000004e-05 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.5565730980000003, 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.5523030689999997, 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:134 3.2 3:4272d415:::200.0000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.5516758189999997, 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010663280000000001, 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901156+0000", 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901158+0000", 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1040000000000001e-06 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901162+0000", 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8789999999999996e-06 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901165+0000", 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1499999999999999e-06 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901211+0000", 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6242000000000002e-05 2024-04-15T23:33:14.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901318+0000", 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106406 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911819+0000", 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010500979000000001 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.8294016109999998, 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.7632489270000002, 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.7632389210000001, 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.7632260090000003, 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.757328024, 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.7561189119999998, 2024-04-15T23:33:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.2891769499999999, 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:14.546 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:14.548 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:14.548 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:14.564+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:14.648 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:14.665+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:14.658 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:14.658 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:14.658 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:14.658 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:14.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:14.749 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:14.766+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:14.816 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:14.816 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:14.817 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:14.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:14.869 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:14.886+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.883082981, 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:14.937 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.938 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:14.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:14.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.88300149299999, 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.943 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.945 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:14.948 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084909802, 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:14.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:14.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:14.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084861812, 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:14.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:14.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.960 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084823513, 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:14.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:14.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08478472500001, 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.966 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:14.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084761394, 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.972 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:14.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:14.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084730909, 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.977 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:14.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:14.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:14.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.983 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08469583999999, 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.985 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:14.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.990 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084672097, 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:14.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:14.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:14.994 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:14.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084619499, 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:14.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:14.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.0845807, 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:15.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.008 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.084545529, 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:15.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08451216100001, 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.014 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:15.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.019 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08445469999999, 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:15.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08281904, 2024-04-15T23:33:15.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:15.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:15.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08192750800001, 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:15.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 104.08183804399999, 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.036 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:15.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:15.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.6748975339999994, 2024-04-15T23:33:15.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.044 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:15.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:15.045 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.045 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.045 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.045 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:15.045 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:15.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.046 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.046 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.046 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:15.046 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:15.046 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.047 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.047 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.047 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:15.047 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:15.047 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.048 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 8.6741621840000001, 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:15.049 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.050 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:15.051 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:15.052 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.053 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.054 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.055 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:15.056 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:15.056 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.056 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.056 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.056 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.056 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.057 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:15.059 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:15.059 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:15.075+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:15.159 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:15.176+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:15.168 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:15.169 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:15.169 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:15.169 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:15.177 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:15.260 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:15.277+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:15.284 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:15.285 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:15.285 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:15.285 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:15.285 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:15.293 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:15.361 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:15.378+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:15.375 INFO:tasks.workunit.client.0.smithi102.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-04-15T23:33:15.375 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether ln -s works... yes 2024-04-15T23:33:15.381 INFO:tasks.workunit.client.0.smithi102.stdout:checking the maximum length of command line arguments... 1572864 2024-04-15T23:33:15.385 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-04-15T23:33:15.385 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-04-15T23:33:15.385 INFO:tasks.workunit.client.0.smithi102.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-04-15T23:33:15.386 INFO:tasks.workunit.client.0.smithi102.stdout:checking for objdump... objdump 2024-04-15T23:33:15.387 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to recognize dependent libraries... pass_all 2024-04-15T23:33:15.387 INFO:tasks.workunit.client.0.smithi102.stdout:checking for dlltool... no 2024-04-15T23:33:15.388 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-04-15T23:33:15.388 INFO:tasks.workunit.client.0.smithi102.stdout:checking for ar... ar 2024-04-15T23:33:15.403 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.551601128, 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:15.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:15.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:15.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.409 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.551544384, 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:15.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.55143322799999, 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.415 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:15.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:15.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.420 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.55134621400001, 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.425 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.551312513, 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010525923, 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868367+0000", 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8400000000000004e-07 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868371+0000", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9709999999999998e-06 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868380+0000", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6200000000000005e-06 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868387+0000", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9079999999999998e-06 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868446+0000", 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9710000000000003e-05 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016533300000000001 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869827+0000", 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001105087 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878790+0000", 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089636739999999996 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878839+0000", 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.878892+0000", 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3106999999999998e-05 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.55107975600001, 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:15.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.551039257, 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:15.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.440 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.215400553, 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:15.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:15.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.8872866000000004, 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:15.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:15.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4201 4.28 4:14d9ac9d:::10000001291.00000000:head [write 0~81] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.8864503500000005, 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010640775, 2024-04-15T23:33:15.451 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4201 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533229+0000", 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533231+0000", 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.844e-06 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533240+0000", 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4460000000000007e-06 2024-04-15T23:33:15.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533268+0000", 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7599000000000001e-05 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533290+0000", 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1923999999999999e-05 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533905+0000", 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061543500000000001 2024-04-15T23:33:15.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533973+0000", 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8430999999999996e-05 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543770+0000", 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097962780000000003 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543808+0000", 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8009000000000001e-05 2024-04-15T23:33:15.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543869+0000", 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1809000000000004e-05 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.5234210069999996, 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.456 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:15.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.5191509779999999, 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:134 3.2 3:4272d415:::200.0000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.5185237279999999, 2024-04-15T23:33:15.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010663280000000001, 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901155+0000", 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901156+0000", 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901158+0000", 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1040000000000001e-06 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901162+0000", 2024-04-15T23:33:15.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8789999999999996e-06 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901165+0000", 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1499999999999999e-06 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901211+0000", 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6242000000000002e-05 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901318+0000", 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106406 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911819+0000", 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010500979000000001 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:15.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7962495199999999, 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7300968359999995, 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7300868300000003, 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:15.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:15.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:15.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:15.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7300739180000004, 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.484 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:15.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:15.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:15.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7241759329999997, 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:15.489 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:15.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:15.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.722966821, 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:15.494 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.256024859, 2024-04-15T23:33:15.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:15.504 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:15.507 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:15.507 INFO:tasks.workunit.client.0.smithi102.stdout:checking for archiver @FILE support... @ 2024-04-15T23:33:15.507 INFO:tasks.workunit.client.0.smithi102.stdout:checking for strip... strip 2024-04-15T23:33:15.507 INFO:tasks.workunit.client.0.smithi102.stdout:checking for ranlib... ranlib 2024-04-15T23:33:15.507 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gawk... gawk 2024-04-15T23:33:15.508 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:15.523+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:15.587 INFO:tasks.workunit.client.0.smithi102.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-04-15T23:33:15.588 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sysroot... no 2024-04-15T23:33:15.597 INFO:tasks.workunit.client.0.smithi102.stdout:checking for a working dd... /usr/bin/dd 2024-04-15T23:33:15.603 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-04-15T23:33:15.606 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:15.623+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:15.618 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:15.618 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:15.618 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:15.618 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:15.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:15.628 INFO:tasks.workunit.client.0.smithi102.stdout:checking for mt... no 2024-04-15T23:33:15.636 INFO:tasks.workunit.client.0.smithi102.stdout:checking if : is a manifest tool... no 2024-04-15T23:33:15.711 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:15.728+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:15.720 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to run the C preprocessor... gcc -E 2024-04-15T23:33:15.776 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:15.777 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:15.777 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:15.777 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:15.777 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:15.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:15.827 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:15.844+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:15.909 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:15.926+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:15.920 INFO:tasks.workunit.client.0.smithi102.stdout:checking for ANSI C header files... yes 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.885274701, 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:15.939 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.940 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.941 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:15.942 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.943 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.88519321299999, 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.945 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:15.946 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.947 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.949 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.950 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.087101522, 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.951 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.952 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.953 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.954 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.955 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.087053532, 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.956 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:15.957 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.958 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.959 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.960 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:15.961 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.087015233, 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.962 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:15.963 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:15.964 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:15.965 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.966 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.086976445, 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.967 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.968 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:15.969 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.970 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.971 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.086953114, 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.972 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.973 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.974 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:15.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:15.976 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.977 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.086922629, 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.978 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.979 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:15.980 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:15.981 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.982 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08688755999999, 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.983 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08686381699999, 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:15.990 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.991 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:15.992 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:15.993 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.086811219, 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:15.994 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:15.995 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:15.996 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:15.997 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.998 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:15.999 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08677242, 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.000 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.001 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:16.002 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:16.003 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:16.004 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.086737249, 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.005 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.006 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.007 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.008 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.009 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08670388100001, 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.010 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:16.011 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.012 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:16.013 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:16.014 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08664641999999, 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:16.015 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.016 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.017 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.018 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.019 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08501076, 2024-04-15T23:33:16.020 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.021 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.022 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.023 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.024 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:16.025 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08411922800001, 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.026 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.027 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.028 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.029 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:16.030 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 105.08402976399999, 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:16.031 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:16.032 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:16.033 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.6770892540000002, 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:16.034 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.035 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.036 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.037 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.038 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 9.6763539039999991, 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:16.039 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:16.040 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:16.041 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:16.042 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:16.043 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:16.044 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:16.044 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:16.046 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/types.h... yes 2024-04-15T23:33:16.046 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/stat.h... yes 2024-04-15T23:33:16.046 INFO:tasks.workunit.client.0.smithi102.stdout:checking for stdlib.h... yes 2024-04-15T23:33:16.046 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:16.062+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:16.046 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:16.073 INFO:tasks.workunit.client.0.smithi102.stdout:checking for string.h... yes 2024-04-15T23:33:16.122 INFO:tasks.workunit.client.0.smithi102.stdout:checking for memory.h... yes 2024-04-15T23:33:16.146 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:16.163+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:16.158 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:16.158 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:16.161 INFO:tasks.workunit.client.0.smithi102.stdout:checking for strings.h... yes 2024-04-15T23:33:16.166 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:16.200 INFO:tasks.workunit.client.0.smithi102.stdout:checking for inttypes.h... yes 2024-04-15T23:33:16.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:16.239 INFO:tasks.workunit.client.0.smithi102.stdout:checking for stdint.h... yes 2024-04-15T23:33:16.247 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:16.264+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:16.276 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:16.276 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:16.281 INFO:tasks.workunit.client.0.smithi102.stdout:checking for unistd.h... yes 2024-04-15T23:33:16.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:16.324 INFO:tasks.workunit.client.0.smithi102.stdout:checking for dlfcn.h... yes 2024-04-15T23:33:16.330 INFO:tasks.workunit.client.0.smithi102.stdout:checking for objdir... .libs 2024-04-15T23:33:16.348 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:16.365+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:16.349 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:16.350 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:16.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:33:16.369 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:16.369 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:16.369 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:16.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:16.373 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:16.435 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:16.435 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:16.437 INFO:tasks.workunit.client.0.smithi102.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-04-15T23:33:16.438 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-04-15T23:33:16.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:16.449 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:16.466+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:16.468 INFO:tasks.workunit.client.0.smithi102.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-04-15T23:33:16.499 INFO:tasks.workunit.client.0.smithi102.stdout:checking if gcc static flag -static works... no 2024-04-15T23:33:16.546 INFO:tasks.workunit.client.0.smithi102.stdout:checking if gcc supports -c -o file.o... yes 2024-04-15T23:33:16.546 INFO:tasks.workunit.client.0.smithi102.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-04-15T23:33:16.549 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:16.566+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:16.553 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-04-15T23:33:16.554 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:16.554 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:16.563 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:16.622 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether -lc should be explicitly linked in... no 2024-04-15T23:33:16.650 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:16.667+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:16.670 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:16.670 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:16.679 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:16.691 INFO:tasks.workunit.client.0.smithi102.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-04-15T23:33:16.692 INFO:tasks.workunit.client.0.smithi102.stdout:checking how to hardcode library paths into programs... immediate 2024-04-15T23:33:16.693 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether stripping libraries is possible... yes 2024-04-15T23:33:16.694 INFO:tasks.workunit.client.0.smithi102.stdout:checking if libtool supports shared libraries... yes 2024-04-15T23:33:16.694 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether to build shared libraries... yes 2024-04-15T23:33:16.694 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether to build static libraries... yes 2024-04-15T23:33:16.701 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gcc... (cached) gcc 2024-04-15T23:33:16.729 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-15T23:33:16.729 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-15T23:33:16.730 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-15T23:33:16.730 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gmake... /usr/bin/gmake 2024-04-15T23:33:16.731 INFO:tasks.workunit.client.0.smithi102.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-04-15T23:33:16.731 INFO:tasks.workunit.client.0.smithi102.stdout:checking for tar... /bin/tar 2024-04-15T23:33:16.731 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gzip... /bin/gzip 2024-04-15T23:33:16.752 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:16.769+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:16.756 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether gcc -MM is supported... yes 2024-04-15T23:33:16.756 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sort... /bin/sort 2024-04-15T23:33:16.757 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether ln -s works... yes 2024-04-15T23:33:16.757 INFO:tasks.workunit.client.0.smithi102.stdout:checking for rpm... /bin/rpm 2024-04-15T23:33:16.761 INFO:tasks.workunit.client.0.smithi102.stdout:checking for rpmbuild... no 2024-04-15T23:33:16.761 INFO:tasks.workunit.client.0.smithi102.stdout:checking for ANSI C header files... (cached) yes 2024-04-15T23:33:16.788 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:16.788 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:16.798 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:16.805 INFO:tasks.workunit.client.0.smithi102.stdout:checking assert.h usability... yes 2024-04-15T23:33:16.818 INFO:tasks.workunit.client.0.smithi102.stdout:checking assert.h presence... yes 2024-04-15T23:33:16.818 INFO:tasks.workunit.client.0.smithi102.stdout:checking for assert.h... yes 2024-04-15T23:33:16.852 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:16.869+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:16.864 INFO:tasks.workunit.client.0.smithi102.stdout:checking bstring.h usability... no 2024-04-15T23:33:16.891 INFO:tasks.workunit.client.0.smithi102.stdout:checking bstring.h presence... no 2024-04-15T23:33:16.891 INFO:tasks.workunit.client.0.smithi102.stdout:checking for bstring.h... no 2024-04-15T23:33:16.910 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:16.910 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:16.920 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:16.936 INFO:tasks.workunit.client.0.smithi102.stdout:checking libgen.h usability... yes 2024-04-15T23:33:16.949 INFO:tasks.workunit.client.0.smithi102.stdout:checking libgen.h presence... yes 2024-04-15T23:33:16.949 INFO:tasks.workunit.client.0.smithi102.stdout:checking for libgen.h... yes 2024-04-15T23:33:16.953 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:16.970+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.003 INFO:tasks.workunit.client.0.smithi102.stdout:checking dirent.h usability... yes 2024-04-15T23:33:17.016 INFO:tasks.workunit.client.0.smithi102.stdout:checking dirent.h presence... yes 2024-04-15T23:33:17.016 INFO:tasks.workunit.client.0.smithi102.stdout:checking for dirent.h... yes 2024-04-15T23:33:17.054 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:17.071+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.059 INFO:tasks.workunit.client.0.smithi102.stdout:checking errno.h usability... yes 2024-04-15T23:33:17.069 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.069 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.072 INFO:tasks.workunit.client.0.smithi102.stdout:checking errno.h presence... yes 2024-04-15T23:33:17.072 INFO:tasks.workunit.client.0.smithi102.stdout:checking for errno.h... yes 2024-04-15T23:33:17.078 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:17.119 INFO:tasks.workunit.client.0.smithi102.stdout:checking malloc.h usability... yes 2024-04-15T23:33:17.134 INFO:tasks.workunit.client.0.smithi102.stdout:checking malloc.h presence... yes 2024-04-15T23:33:17.134 INFO:tasks.workunit.client.0.smithi102.stdout:checking for malloc.h... yes 2024-04-15T23:33:17.154 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:17.171+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.175 INFO:tasks.workunit.client.0.smithi102.stdout:checking uuid.h usability... no 2024-04-15T23:33:17.187 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.187 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.195 INFO:tasks.workunit.client.0.smithi102.stdout:checking uuid.h presence... no 2024-04-15T23:33:17.195 INFO:tasks.workunit.client.0.smithi102.stdout:checking for uuid.h... no 2024-04-15T23:33:17.196 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:17.238 INFO:tasks.workunit.client.0.smithi102.stdout:checking uuid/uuid.h usability... yes 2024-04-15T23:33:17.253 INFO:tasks.workunit.client.0.smithi102.stdout:checking uuid/uuid.h presence... yes 2024-04-15T23:33:17.254 INFO:tasks.workunit.client.0.smithi102.stdout:checking for uuid/uuid.h... yes 2024-04-15T23:33:17.255 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:17.272+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.296 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/uuid.h usability... no 2024-04-15T23:33:17.306 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.306 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.315 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:17.316 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/uuid.h presence... no 2024-04-15T23:33:17.316 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/uuid.h... no 2024-04-15T23:33:17.353 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/file.h usability... yes 2024-04-15T23:33:17.355 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:17.372+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:17.367 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/file.h presence... yes 2024-04-15T23:33:17.367 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/file.h... yes 2024-04-15T23:33:17.388 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:33:17.415 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/fcntl.h usability... yes 2024-04-15T23:33:17.429 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/fcntl.h presence... yes 2024-04-15T23:33:17.429 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/fcntl.h... yes 2024-04-15T23:33:17.456 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:17.472+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:17.465 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.465 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.473 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/syssgi.h usability... no 2024-04-15T23:33:17.474 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:17.493 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/syssgi.h presence... no 2024-04-15T23:33:17.494 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/syssgi.h... no 2024-04-15T23:33:17.557 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:17.574+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.583 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.584 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.590 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/param.h usability... yes 2024-04-15T23:33:17.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:17.607 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/param.h presence... yes 2024-04-15T23:33:17.607 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/param.h... yes 2024-04-15T23:33:17.616 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/stat.h... (cached) yes 2024-04-15T23:33:17.657 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/statvfs.h usability... yes 2024-04-15T23:33:17.658 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:17.674+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:17.670 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/statvfs.h presence... yes 2024-04-15T23:33:17.670 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/statvfs.h... yes 2024-04-15T23:33:17.702 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.702 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.710 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/time.h usability... yes 2024-04-15T23:33:17.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:17.724 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/time.h presence... yes 2024-04-15T23:33:17.724 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/time.h... yes 2024-04-15T23:33:17.759 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:17.776+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.766 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/ioctl.h usability... yes 2024-04-15T23:33:17.779 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/ioctl.h presence... yes 2024-04-15T23:33:17.779 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/ioctl.h... yes 2024-04-15T23:33:17.822 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/wait.h usability... yes 2024-04-15T23:33:17.837 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/wait.h presence... yes 2024-04-15T23:33:17.837 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/wait.h... yes 2024-04-15T23:33:17.850 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/types.h... (cached) yes 2024-04-15T23:33:17.859 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:17.876+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:17.860 INFO:tasks.workunit.client.0.smithi102.stdout:checking for strings.h... (cached) yes 2024-04-15T23:33:17.862 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.862 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:17.907 INFO:tasks.workunit.client.0.smithi102.stdout:checking err.h usability... yes 2024-04-15T23:33:17.921 INFO:tasks.workunit.client.0.smithi102.stdout:checking err.h presence... yes 2024-04-15T23:33:17.921 INFO:tasks.workunit.client.0.smithi102.stdout:checking for err.h... yes 2024-04-15T23:33:17.960 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:17.976+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:17.967 INFO:tasks.workunit.client.0.smithi102.stdout:checking linux/falloc.h usability... yes 2024-04-15T23:33:17.979 INFO:tasks.workunit.client.0.smithi102.stdout:checking linux/falloc.h presence... yes 2024-04-15T23:33:17.979 INFO:tasks.workunit.client.0.smithi102.stdout:checking for linux/falloc.h... yes 2024-04-15T23:33:17.983 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:17.983 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:17.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:18.021 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-04-15T23:33:18.042 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-04-15T23:33:18.042 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/fs/xfs_fsops.h... no 2024-04-15T23:33:18.061 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:18.078+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:18.078 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/fs/xfs_itable.h usability... no 2024-04-15T23:33:18.099 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/fs/xfs_itable.h presence... no 2024-04-15T23:33:18.099 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/fs/xfs_itable.h... no 2024-04-15T23:33:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:18.103 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:18.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:18.136 INFO:tasks.workunit.client.0.smithi102.stdout:checking xfs/platform_defs.h usability... no 2024-04-15T23:33:18.157 INFO:tasks.workunit.client.0.smithi102.stdout:checking xfs/platform_defs.h presence... no 2024-04-15T23:33:18.157 INFO:tasks.workunit.client.0.smithi102.stdout:checking for xfs/platform_defs.h... no 2024-04-15T23:33:18.162 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:18.179+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:18.196 INFO:tasks.workunit.client.0.smithi102.stdout:checking btrfs/ioctl.h usability... no 2024-04-15T23:33:18.217 INFO:tasks.workunit.client.0.smithi102.stdout:checking btrfs/ioctl.h presence... no 2024-04-15T23:33:18.217 INFO:tasks.workunit.client.0.smithi102.stdout:checking for btrfs/ioctl.h... no 2024-04-15T23:33:18.221 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:18.221 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:18.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:18.254 INFO:tasks.workunit.client.0.smithi102.stdout:checking cifs/ioctl.h usability... no 2024-04-15T23:33:18.263 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:18.279+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:18.275 INFO:tasks.workunit.client.0.smithi102.stdout:checking cifs/ioctl.h presence... no 2024-04-15T23:33:18.275 INFO:tasks.workunit.client.0.smithi102.stdout:checking for cifs/ioctl.h... no 2024-04-15T23:33:18.312 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/mman.h usability... yes 2024-04-15T23:33:18.325 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/mman.h presence... yes 2024-04-15T23:33:18.326 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/mman.h... yes 2024-04-15T23:33:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:18.341 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:18.350 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:18.354 INFO:tasks.workunit.client.0.smithi102.stdout:checking for xfs/xfs_log_format.h... no 2024-04-15T23:33:18.363 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:18.380+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:18.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:18.411 INFO:tasks.workunit.client.0.smithi102.stdout:checking for uuid_compare... no 2024-04-15T23:33:18.458 INFO:tasks.workunit.client.0.smithi102.stdout:checking for uuid_compare in -luuid... yes 2024-04-15T23:33:18.460 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:18.461 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:18.466 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:18.483+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:18.470 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:18.506 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:18.507 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:18.525 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:18.525 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:18.525 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:18.528 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:18.529 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:18.531 INFO:tasks.workunit.client.0.smithi102.stdout:checking for xfs/xfs.h... yes 2024-04-15T23:33:18.555 INFO:tasks.workunit.client.0.smithi102.stdout:checking for xfs/libxfs.h... no 2024-04-15T23:33:18.567 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:18.584+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:18.579 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:18.579 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:18.579 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:18.579 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:18.579 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:18.580 INFO:tasks.workunit.client.0.smithi102.stdout:checking whether xlog_assign_lsn is declared... no 2024-04-15T23:33:18.588 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:18.617 INFO:tasks.workunit.client.0.smithi102.stdout:checking for xfs/xqm.h... yes 2024-04-15T23:33:18.668 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:18.685+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:18.679 INFO:tasks.workunit.client.0.smithi102.stdout:checking xfsctl from xfs/xfs.h... ok 2024-04-15T23:33:18.712 INFO:tasks.workunit.client.0.smithi102.stdout:checking xfs/handle.h usability... yes 2024-04-15T23:33:18.724 INFO:tasks.workunit.client.0.smithi102.stdout:checking xfs/handle.h presence... yes 2024-04-15T23:33:18.724 INFO:tasks.workunit.client.0.smithi102.stdout:checking for xfs/handle.h... yes 2024-04-15T23:33:18.740 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.888441606, 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.888384862, 2024-04-15T23:33:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.88827370600001, 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.888186692, 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.88792023400001, 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.887879735, 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.552241030999999, 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.224127078, 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.776 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:18.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:18.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:18.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8602614850000005, 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:18.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:18.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.785 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8559914559999999, 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:18.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:18.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.1330899979999991, 2024-04-15T23:33:18.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:18.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0669373140000005, 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0669273080000004, 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:18.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.805 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0669143959999996, 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.810 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0610164110000007, 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0598072989999991, 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:18.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:18.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.5928653370000001, 2024-04-15T23:33:18.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:18.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:18.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3028 3.0 3:02ac1934:::200.00000009:head [write 1110102~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0667094929999998, 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012674134, 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689826+0000", 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5659999999999999e-05 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689827+0000", 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6649999999999999e-06 2024-04-15T23:33:18.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689830+0000", 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.101e-06 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689833+0000", 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6450000000000001e-06 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693747+0000", 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039136010000000001 2024-04-15T23:33:18.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693821+0000", 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3831999999999994e-05 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693945+0000", 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012467500000000001 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695419+0000", 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014735830000000001 2024-04-15T23:33:18.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702324+0000", 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069050140000000001 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702413+0000", 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345000000000006e-05 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702484+0000", 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1013000000000006e-05 2024-04-15T23:33:18.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3029 3.0 3:02ac1934:::200.00000009:head [write 1111504~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0666778199999998, 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862877, 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5800000000000001e-07 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689847+0000", 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5929999999999999e-06 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689850+0000", 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6150000000000001e-06 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689853+0000", 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9519999999999999e-06 2024-04-15T23:33:18.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694528+0000", 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004674648 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694574+0000", 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5729999999999998e-05 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694641+0000", 2024-04-15T23:33:18.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7378000000000004e-05 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695426+0000", 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078491800000000001 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702611+0000", 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071851559999999998 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702665+0000", 2024-04-15T23:33:18.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.384e-05 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702705+0000", 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9789000000000001e-05 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3030 3.0 3:02ac1934:::200.00000009:head [write 1112906~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.0666622700000001, 2024-04-15T23:33:18.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012941556, 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:18.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689858+0000", 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.79e-07 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689859+0000", 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6080000000000001e-06 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689862+0000", 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9919999999999999e-06 2024-04-15T23:33:18.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689865+0000", 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5799999999999999e-06 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694860+0000", 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049954470000000001 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694933+0000", 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2515000000000006e-05 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695060+0000", 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127799 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.696305+0000", 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012449959999999999 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702748+0000", 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064427699999999996 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702776+0000", 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059e-05 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702799+0000", 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2510999999999998e-05 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:18.842 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:18.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:18.846 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:18.860+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:18.846 INFO:tasks.workunit.client.0.smithi102.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-04-15T23:33:18.846 INFO:tasks.workunit.client.0.smithi102.stdout:checking attr/attributes.h usability... yes 2024-04-15T23:33:18.846 INFO:tasks.workunit.client.0.smithi102.stdout:checking attr/attributes.h presence... yes 2024-04-15T23:33:18.846 INFO:tasks.workunit.client.0.smithi102.stdout:checking for attr/attributes.h... yes 2024-04-15T23:33:18.884 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/attributes.h usability... no 2024-04-15T23:33:18.906 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/attributes.h presence... no 2024-04-15T23:33:18.906 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/attributes.h... no 2024-04-15T23:33:18.944 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:18.961+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:18.953 INFO:tasks.workunit.client.0.smithi102.stdout:checking for attr_list in -lattr... yes 2024-04-15T23:33:18.960 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:18.960 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:18.960 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:18.960 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:18.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:19.000 INFO:tasks.workunit.client.0.smithi102.stdout:checking for attr_set in -lattr... yes 2024-04-15T23:33:19.044 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:19.062+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:19.050 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/acl.h usability... yes 2024-04-15T23:33:19.064 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/acl.h presence... yes 2024-04-15T23:33:19.064 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/acl.h... yes 2024-04-15T23:33:19.079 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:19.079 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:19.079 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:19.079 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:19.079 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:19.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:19.099 INFO:tasks.workunit.client.0.smithi102.stdout:checking acl/libacl.h usability... yes 2024-04-15T23:33:19.113 INFO:tasks.workunit.client.0.smithi102.stdout:checking acl/libacl.h presence... yes 2024-04-15T23:33:19.114 INFO:tasks.workunit.client.0.smithi102.stdout:checking for acl/libacl.h... yes 2024-04-15T23:33:19.145 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:19.162+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:19.161 INFO:tasks.workunit.client.0.smithi102.stdout:checking for acl_init in -lacl... yes 2024-04-15T23:33:19.195 INFO:tasks.workunit.client.0.smithi102.stdout:checking gdbm-ndbm.h usability... no 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.145388883, 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.204 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.145307395, 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.205 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:19.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.208 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.209 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.34721570400001, 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.210 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:19.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.34716771399999, 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.215 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:19.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:19.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:19.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:19.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.347129415, 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.220 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:19.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:19.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.347090627, 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.225 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:19.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.228 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.34706729600001, 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.230 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:19.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.347036811, 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:19.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:19.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:19.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.347001742, 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:19.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:19.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.244 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.346977999, 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:19.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.249 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.34692540099999, 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:19.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.346886602, 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:19.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:19.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:19.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.259 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.346851431, 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.346818063, 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:19.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:19.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.269 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.346760602, 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:19.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:19.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.274 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.345124942, 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:19.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.34423341, 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:19.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.284 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 108.344143946, 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:19.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:19.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:19.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.937203436000001, 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.288 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:19.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 12.936468086, 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:19.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.297 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:19.299 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:19.315+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:19.300 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:19.300 INFO:tasks.workunit.client.0.smithi102.stdout:checking gdbm-ndbm.h presence... no 2024-04-15T23:33:19.300 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gdbm-ndbm.h... no 2024-04-15T23:33:19.301 INFO:tasks.workunit.client.0.smithi102.stdout:checking gdbm/ndbm.h usability... no 2024-04-15T23:33:19.301 INFO:tasks.workunit.client.0.smithi102.stdout:checking gdbm/ndbm.h presence... no 2024-04-15T23:33:19.301 INFO:tasks.workunit.client.0.smithi102.stdout:checking for gdbm/ndbm.h... no 2024-04-15T23:33:19.303 INFO:tasks.workunit.client.0.smithi102.stdout:checking ndbm.h usability... no 2024-04-15T23:33:19.323 INFO:tasks.workunit.client.0.smithi102.stdout:checking ndbm.h presence... no 2024-04-15T23:33:19.323 INFO:tasks.workunit.client.0.smithi102.stdout:checking for ndbm.h... no 2024-04-15T23:33:19.354 INFO:tasks.workunit.client.0.smithi102.stdout:checking libaio.h usability... yes 2024-04-15T23:33:19.368 INFO:tasks.workunit.client.0.smithi102.stdout:checking libaio.h presence... yes 2024-04-15T23:33:19.369 INFO:tasks.workunit.client.0.smithi102.stdout:checking for libaio.h... yes 2024-04-15T23:33:19.399 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:19.416+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:19.402 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout:checking for dm_make_handle in -ldm... no 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout:WARNING: could not find a valid DMAPI base library. 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout:If you want DMAPI support please install the data migration 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout:from the dmapi source. 2024-04-15T23:33:19.410 INFO:tasks.workunit.client.0.smithi102.stdout: 2024-04-15T23:33:19.411 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:19.411 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:19.420 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:19.441 INFO:tasks.workunit.client.0.smithi102.stdout:checking linux/fiemap.h usability... yes 2024-04-15T23:33:19.454 INFO:tasks.workunit.client.0.smithi102.stdout:checking linux/fiemap.h presence... yes 2024-04-15T23:33:19.454 INFO:tasks.workunit.client.0.smithi102.stdout:checking for linux/fiemap.h... yes 2024-04-15T23:33:19.500 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:19.517+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:19.503 INFO:tasks.workunit.client.0.smithi102.stdout:checking for fallocate... yes 2024-04-15T23:33:19.565 INFO:tasks.workunit.client.0.smithi102.stdout:checking for open_by_handle_at... yes 2024-04-15T23:33:19.568 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:19.568 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:19.568 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:19.568 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:19.568 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:19.577 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:19.611 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/prctl.h usability... yes 2024-04-15T23:33:19.620 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:19.637+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:19.624 INFO:tasks.workunit.client.0.smithi102.stdout:checking sys/prctl.h presence... yes 2024-04-15T23:33:19.625 INFO:tasks.workunit.client.0.smithi102.stdout:checking for sys/prctl.h... yes 2024-04-15T23:33:19.658 INFO:tasks.workunit.client.0.smithi102.stdout:checking linux/fs.h usability... yes 2024-04-15T23:33:19.671 INFO:tasks.workunit.client.0.smithi102.stdout:checking linux/fs.h presence... yes 2024-04-15T23:33:19.671 INFO:tasks.workunit.client.0.smithi102.stdout:checking for linux/fs.h... yes 2024-04-15T23:33:19.688 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:19.688 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:19.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:19.688 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:19.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.688 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.836155455, 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.83609871100001, 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:19.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:19.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:19.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:19.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:19.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.835987555, 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:19.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:19.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.835900541, 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.716 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.835634083, 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.722 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.83559358399999, 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:19.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:19.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.499954880000001, 2024-04-15T23:33:19.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:19.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:19.732 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.171840927, 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:19.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:19.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.807975334, 2024-04-15T23:33:19.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:19.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:19.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8037053049999994, 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:19.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0808038470000003, 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:19.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:19.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:19.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0146511629999999, 2024-04-15T23:33:19.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:19.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:19.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.756 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0146411569999998, 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0146282450000008, 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.762 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:19.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:19.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:19.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0087302600000001, 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0075211480000004, 2024-04-15T23:33:19.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:19.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:19.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.781 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5405791860000004, 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:19.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:19.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:19.789 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3028 3.0 3:02ac1934:::200.00000009:head [write 1110102~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0144233419999997, 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012674134, 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689826+0000", 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5659999999999999e-05 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689827+0000", 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6649999999999999e-06 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689830+0000", 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.101e-06 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689833+0000", 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6450000000000001e-06 2024-04-15T23:33:19.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693747+0000", 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039136010000000001 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693821+0000", 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3831999999999994e-05 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693945+0000", 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012467500000000001 2024-04-15T23:33:19.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695419+0000", 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014735830000000001 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702324+0000", 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069050140000000001 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702413+0000", 2024-04-15T23:33:19.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345000000000006e-05 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702484+0000", 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1013000000000006e-05 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3029 3.0 3:02ac1934:::200.00000009:head [write 1111504~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0143916690000001, 2024-04-15T23:33:19.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862877, 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5800000000000001e-07 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689847+0000", 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5929999999999999e-06 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689850+0000", 2024-04-15T23:33:19.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6150000000000001e-06 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689853+0000", 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9519999999999999e-06 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694528+0000", 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004674648 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694574+0000", 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5729999999999998e-05 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694641+0000", 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7378000000000004e-05 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695426+0000", 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078491800000000001 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702611+0000", 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071851559999999998 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702665+0000", 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.384e-05 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702705+0000", 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9789000000000001e-05 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3030 3.0 3:02ac1934:::200.00000009:head [write 1112906~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0143761189999996, 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012941556, 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:19.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689858+0000", 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.79e-07 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689859+0000", 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6080000000000001e-06 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689862+0000", 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9919999999999999e-06 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689865+0000", 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5799999999999999e-06 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694860+0000", 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049954470000000001 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694933+0000", 2024-04-15T23:33:19.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2515000000000006e-05 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695060+0000", 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127799 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.696305+0000", 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012449959999999999 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702748+0000", 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064427699999999996 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702776+0000", 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059e-05 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:19.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702799+0000", 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2510999999999998e-05 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:19.807 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:19.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-04-15T23:33:19.809 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:19.825+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:19.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:19.811 INFO:tasks.workunit.client.0.smithi102.stdout:checking btrfsutil.h usability... no 2024-04-15T23:33:19.811 INFO:tasks.workunit.client.0.smithi102.stdout:checking btrfsutil.h presence... no 2024-04-15T23:33:19.811 INFO:tasks.workunit.client.0.smithi102.stdout:checking for btrfsutil.h... no 2024-04-15T23:33:19.811 INFO:tasks.workunit.client.0.smithi102.stdout:checking for copy_file_range... yes 2024-04-15T23:33:19.826 INFO:tasks.workunit.client.0.smithi102.stdout:checking for renameat2... yes 2024-04-15T23:33:19.846 INFO:tasks.workunit.client.0.smithi102.stdout:configure: creating ./config.status 2024-04-15T23:33:19.909 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:19.926+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_repop(mds.0.3:3499 4.22 e49/13 4:44399015:::10000001b82.00000000:head v 49'182, mlcod=49'180)", 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:19.943046+0000", 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 0.0014119650000000001, 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0014265180000000001, 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:19.927 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943046+0000", 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943046+0000", 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943046+0000", 2024-04-15T23:33:19.928 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7199999999999999e-07 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943050+0000", 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9079999999999997e-06 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943057+0000", 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9469999999999997e-06 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.929 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943063+0000", 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.8730000000000004e-06 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943256+0000", 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019290999999999999 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:19.943272+0000", 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.6169000000000001e-05 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.930 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:19.931 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.931 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:19.931 INFO:teuthology.orchestra.run.smithi115.stdout: ], 2024-04-15T23:33:19.931 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 1 2024-04-15T23:33:19.931 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:19.936 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:20.020 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:20.037+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:20.086 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:20.086 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:20.086 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:20.086 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:20.086 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:20.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:20.136 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:20.153+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:20.196 INFO:tasks.workunit.client.0.smithi102.stdout:config.status: creating include/builddefs 2024-04-15T23:33:20.212 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:20.228+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:20.212 INFO:tasks.workunit.client.0.smithi102.stdout:config.status: creating include/config.h 2024-04-15T23:33:20.224 INFO:tasks.workunit.client.0.smithi102.stdout:config.status: executing libtool commands 2024-04-15T23:33:20.246 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:20.246 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:20.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:20.246 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 114.192614236, 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:20.247 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:20.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.252 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 114.192532748, 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:20.253 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:20.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39444105699999, 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.259 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:20.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:20.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.394393067, 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:20.265 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:20.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:20.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:20.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.394354768, 2024-04-15T23:33:20.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:20.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:20.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39431598, 2024-04-15T23:33:20.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:20.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:20.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39429264899999, 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:20.283 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.394262164, 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:20.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:20.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:20.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:20.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39422709500001, 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:20.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:20.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.301 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39420335200001, 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.306 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39415075399999, 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:20.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:20.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:20.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:20.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.313 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.394111955, 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:20.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:20.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39407678400001, 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:20.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:20.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:20.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:20.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:20.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:20.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:20.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:20.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:20.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:20.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:20.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:20.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:20.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:20.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:20.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:20.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:20.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.330 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:20.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.331 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.332 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:20.332 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.394043416, 2024-04-15T23:33:20.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:20.332 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.332 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.332 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.333 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:20.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:20.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:20.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:20.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:20.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:20.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:20.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:20.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:20.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:20.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:20.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:20.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:20.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:20.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:20.340 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:20.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:20.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:20.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:20.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:20.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:20.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:20.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:20.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.344 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.344 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.345 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.345 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:20.345 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.39398595500001, 2024-04-15T23:33:20.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:20.345 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.345 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.346 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.346 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:20.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:20.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.348 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:20.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:20.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:20.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:20.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:20.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.392350295, 2024-04-15T23:33:20.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:20.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:20.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:20.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.365 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:20.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:20.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:20.370 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.371 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.391458763, 2024-04-15T23:33:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.372 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.374 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:20.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:20.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:20.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:20.379 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:20.380 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.381 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.384 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 109.391369299, 2024-04-15T23:33:20.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.386 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.387 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:20.388 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:20.389 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.390 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.391 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.392 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.393 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:20.394 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.984428789000001, 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.395 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.396 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:20.397 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:20.398 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 13.983693439, 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:20.399 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:20.400 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.401 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.402 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:20.403 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:20.404 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:20.406 INFO:tasks.workunit.client.0.smithi102.stdout:Building include 2024-04-15T23:33:20.406 INFO:tasks.workunit.client.0.smithi102.stdout:Building lib 2024-04-15T23:33:20.406 INFO:tasks.workunit.client.0.smithi102.stdout:Building tests 2024-04-15T23:33:20.406 INFO:tasks.workunit.client.0.smithi102.stdout: [LTDEP] 2024-04-15T23:33:20.406 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:33:20.407 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:20.407 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:20.422+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:20.506 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:20.523+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:20.516 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:20.517 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:20.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:20.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:20.609 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] dataascii.lo 2024-04-15T23:33:20.610 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] databin.lo 2024-04-15T23:33:20.610 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] datapid.lo 2024-04-15T23:33:20.610 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:20.627+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:20.610 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] file_lock.lo 2024-04-15T23:33:20.676 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:20.676 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:20.681 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:20.681 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:20.685 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:20.707 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:20.708 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:20.708 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:20.724+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:20.712 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:20.712 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:20.786 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] forker.lo 2024-04-15T23:33:20.786 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] pattern.lo 2024-04-15T23:33:20.808 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:20.825+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:20.834 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:20.834 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:20.843 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:20.844 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] open_flags.lo 2024-04-15T23:33:20.854 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] random_range.lo 2024-04-15T23:33:20.909 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:20.926+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:20.949 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] string_to_tokens.lo 2024-04-15T23:33:20.960 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:20.960 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:20.968 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:20.993 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] str_to_bytes.lo 2024-04-15T23:33:21.010 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.028+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.055 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] tlibio.lo 2024-04-15T23:33:21.092 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] write_log.lo 2024-04-15T23:33:21.112 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:21.129+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:21.118 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.119 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.127 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:21.180 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] random.lo 2024-04-15T23:33:21.213 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:21.230+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:21.277 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.277 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.286 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:21.330 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.347+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.395 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.395 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.403 INFO:tasks.workunit.client.0.smithi102.stdout: [LD] 2024-04-15T23:33:21.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:21.445 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.462+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.515 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.532+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.544 INFO:tasks.workunit.client.0.smithi102.stdout:Building ltp 2024-04-15T23:33:21.544 INFO:tasks.workunit.client.0.smithi102.stdout:Building src 2024-04-15T23:33:21.544 INFO:tasks.workunit.client.0.smithi102.stdout:Building m4 2024-04-15T23:33:21.544 INFO:tasks.workunit.client.0.smithi102.stdout:Building common 2024-04-15T23:33:21.553 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.553 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.555 INFO:tasks.workunit.client.0.smithi102.stdout: [DEP] 2024-04-15T23:33:21.562 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:21.570 INFO:tasks.workunit.client.0.smithi102.stdout: [DEP] 2024-04-15T23:33:21.646 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.663+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.710 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.710 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.716 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:21.734+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:21.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:21.818 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.835+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.828 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.828 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:21.919 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:21.936+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:21.946 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:21.947 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:21.955 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:22.016 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] doio 2024-04-15T23:33:22.016 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] fsstress 2024-04-15T23:33:22.016 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] fsx 2024-04-15T23:33:22.020 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:22.036+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:22.063 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.063 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:22.121 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:22.138+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:22.182 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.182 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:22.234 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.251+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.268 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c: In function 'attr_list_path': 2024-04-15T23:33:22.268 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-04-15T23:33:22.268 INFO:tasks.workunit.client.0.smithi102.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-04-15T23:33:22.268 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~ 2024-04-15T23:33:22.268 INFO:tasks.workunit.client.0.smithi102.stderr:In file included from ../src/global.h:25, 2024-04-15T23:33:22.268 INFO:tasks.workunit.client.0.smithi102.stderr: from fsstress.c:12: 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~ 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c: In function 'attr_remove_path': 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~ 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:In file included from ../src/global.h:25, 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: from fsstress.c:12: 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~ 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c: In function 'attr_set_path': 2024-04-15T23:33:22.269 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~ 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr:In file included from ../src/global.h:25, 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr: from fsstress.c:12: 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-04-15T23:33:22.270 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~ 2024-04-15T23:33:22.279 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c: In function 'allocsp_f': 2024-04-15T23:33:22.279 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-04-15T23:33:22.279 INFO:tasks.workunit.client.0.smithi102.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-04-15T23:33:22.279 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~~~ 2024-04-15T23:33:22.279 INFO:tasks.workunit.client.0.smithi102.stderr: | XFS_IOC_RESVSP64 2024-04-15T23:33:22.279 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-04-15T23:33:22.297 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c: In function 'freesp_f': 2024-04-15T23:33:22.297 INFO:tasks.workunit.client.0.smithi102.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-04-15T23:33:22.298 INFO:tasks.workunit.client.0.smithi102.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-04-15T23:33:22.298 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~~ 2024-04-15T23:33:22.298 INFO:tasks.workunit.client.0.smithi102.stderr: | XFS_IOC_RESVSP64 2024-04-15T23:33:22.298 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.298 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:22.332 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[3]: *** [Makefile:46: fsstress] Error 1 2024-04-15T23:33:22.332 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-04-15T23:33:22.350 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.365+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:33:22.423 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:22.441+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:22.456 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.456 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.465 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:22.524 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.541+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.575 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.575 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:22.625 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.642+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.690 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.690 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:22.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:22.726 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.743+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr:doio.c: In function 'parse_cmdline': 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: 3113 | fprintf(stderr, 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~ 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-15T23:33:22.773 INFO:tasks.workunit.client.0.smithi102.stderr: 3115 | Prog, TagName, tok); 2024-04-15T23:33:22.774 INFO:tasks.workunit.client.0.smithi102.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-04-15T23:33:22.776 INFO:tasks.workunit.client.0.smithi102.stderr:fsx.c: In function 'main': 2024-04-15T23:33:22.776 INFO:tasks.workunit.client.0.smithi102.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-04-15T23:33:22.776 INFO:tasks.workunit.client.0.smithi102.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-04-15T23:33:22.776 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-15T23:33:22.777 INFO:tasks.workunit.client.0.smithi102.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-04-15T23:33:22.777 INFO:tasks.workunit.client.0.smithi102.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-04-15T23:33:22.777 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-15T23:33:22.806 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:22.806 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:22.814 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:22.859 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.876+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.874 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:22.874 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:22.902 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:22.902 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:22.906 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:22.906 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:22.922 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-04-15T23:33:22.922 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-04-15T23:33:22.924 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:22.925 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:22.925 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:22.928 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:22.945+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:22.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:23.029 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.046+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.082 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:23.082 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:23.091 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:23.130 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.147+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.348622538, 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.348565794, 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:23.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.34845463800001, 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.212 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:23.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.217 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.34836762400001, 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:23.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:23.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.222 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.34810116600001, 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:23.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:23.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.348060667, 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:23.228 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:23.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.012421963000001, 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.232 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:23.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.684308010000001, 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:23.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:23.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:23.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:23.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.320442417000001, 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:23.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:23.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:23.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.316172388, 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:23.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.251 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.593270929999999, 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:23.256 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.527118246000001, 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:23.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:23.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:23.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.52710824, 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:23.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:23.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:23.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.527095328, 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:23.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.521197343000001, 2024-04-15T23:33:23.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:23.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:23.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:23.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.277 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.519988230999999, 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.282 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.053046268999999, 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:23.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:23.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3028 3.0 3:02ac1934:::200.00000009:head [write 1110102~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.5268904250000004, 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012674134, 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.288 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689826+0000", 2024-04-15T23:33:23.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5659999999999999e-05 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689827+0000", 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6649999999999999e-06 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689830+0000", 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.101e-06 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689833+0000", 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6450000000000001e-06 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693747+0000", 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039136010000000001 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693821+0000", 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3831999999999994e-05 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693945+0000", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012467500000000001 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695419+0000", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014735830000000001 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702324+0000", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069050140000000001 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702413+0000", 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345000000000006e-05 2024-04-15T23:33:23.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702484+0000", 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1013000000000006e-05 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3029 3.0 3:02ac1934:::200.00000009:head [write 1111504~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.5268587519999999, 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862877, 2024-04-15T23:33:23.293 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5800000000000001e-07 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689847+0000", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5929999999999999e-06 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689850+0000", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6150000000000001e-06 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689853+0000", 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9519999999999999e-06 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694528+0000", 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004674648 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694574+0000", 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5729999999999998e-05 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694641+0000", 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7378000000000004e-05 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695426+0000", 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078491800000000001 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702611+0000", 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071851559999999998 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702665+0000", 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.384e-05 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702705+0000", 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9789000000000001e-05 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.298 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3030 3.0 3:02ac1934:::200.00000009:head [write 1112906~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.5268432020000002, 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012941556, 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689858+0000", 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.79e-07 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689859+0000", 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6080000000000001e-06 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689862+0000", 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9919999999999999e-06 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689865+0000", 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5799999999999999e-06 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694860+0000", 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049954470000000001 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694933+0000", 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2515000000000006e-05 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695060+0000", 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127799 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.696305+0000", 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012449959999999999 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702748+0000", 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064427699999999996 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702776+0000", 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059e-05 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702799+0000", 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2510999999999998e-05 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:23.304 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:23.304 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:23.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:23.306 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:23.321+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:23.404 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:33:23.405 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.422+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.417 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:23.417 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:23.417 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:23.417 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:23.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:23.509 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.526+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.574 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:23.574 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:23.574 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:23.574 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:23.575 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:23.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:23.623 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.640+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.708 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.724+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.731 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.678059421, 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:23.732 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:23.737 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.67797793299999, 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879886242, 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.743 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:23.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:23.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879838252, 2024-04-15T23:33:23.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:23.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.753 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879799953, 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:23.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:23.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:23.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:23.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87976116500001, 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:23.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:23.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:23.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879737834, 2024-04-15T23:33:23.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:23.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:23.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879707349, 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:23.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:23.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:23.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87967227999999, 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.775 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:23.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:23.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:23.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87964853699999, 2024-04-15T23:33:23.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:23.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.785 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879595939, 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87955714, 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:23.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:23.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:23.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:23.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.879521969, 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:23.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87948860100001, 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.801 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:23.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:23.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:23.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87943113999999, 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.806 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:23.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:23.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:23.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:23.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87779548, 2024-04-15T23:33:23.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:23.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:23.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:23.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87690394800001, 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.821 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 112.87681448399999, 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.469873973999999, 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:23.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:23.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:23.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:23.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 17.469138623999999, 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:23.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:23.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.834 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:23.835 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:23.837 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.853+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:23.937 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:23.954+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:23.949 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:23.949 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:23.949 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:23.949 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:23.958 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:24.038 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:24.055+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:24.065 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:24.065 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:24.065 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:24.065 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:24.065 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:24.073 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:24.139 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:24.156+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:24.223 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:24.223 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:24.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:24.223 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.37091849700001, 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:24.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:24.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:24.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.230 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.370861753, 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:24.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.236 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.370750597, 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:24.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:24.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:24.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:24.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.370663583, 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:24.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:24.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:24.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.250 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.250 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:24.250 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.370397125, 2024-04-15T23:33:24.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:24.250 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.370356626, 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:24.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:24.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.034717921999999, 2024-04-15T23:33:24.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.265 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.706603969, 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:24.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.342738376, 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:24.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:24.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:24.275 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.338468346999999, 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:24.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:24.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.615566889, 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.280 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.549414205, 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:24.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.549404199, 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.290 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.295 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.549391287000001, 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:24.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:24.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.543493302, 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:24.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.54228419, 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:24.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:24.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:24.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.075342228, 2024-04-15T23:33:24.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:24.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:24.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3028 3.0 3:02ac1934:::200.00000009:head [write 1110102~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5491863840000004, 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012674134, 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689826+0000", 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5659999999999999e-05 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689827+0000", 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6649999999999999e-06 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689830+0000", 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.101e-06 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689833+0000", 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6450000000000001e-06 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693747+0000", 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039136010000000001 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693821+0000", 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3831999999999994e-05 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693945+0000", 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012467500000000001 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695419+0000", 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014735830000000001 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702324+0000", 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069050140000000001 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702413+0000", 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345000000000006e-05 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702484+0000", 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1013000000000006e-05 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.321 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3029 3.0 3:02ac1934:::200.00000009:head [write 1111504~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5491547109999999, 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862877, 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5800000000000001e-07 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689847+0000", 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5929999999999999e-06 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689850+0000", 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6150000000000001e-06 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689853+0000", 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9519999999999999e-06 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694528+0000", 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004674648 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694574+0000", 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5729999999999998e-05 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694641+0000", 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7378000000000004e-05 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695426+0000", 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078491800000000001 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702611+0000", 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071851559999999998 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702665+0000", 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.384e-05 2024-04-15T23:33:24.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702705+0000", 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9789000000000001e-05 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3030 3.0 3:02ac1934:::200.00000009:head [write 1112906~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5491391609999994, 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012941556, 2024-04-15T23:33:24.327 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689858+0000", 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.79e-07 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689859+0000", 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6080000000000001e-06 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689862+0000", 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9919999999999999e-06 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689865+0000", 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5799999999999999e-06 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694860+0000", 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049954470000000001 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694933+0000", 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2515000000000006e-05 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695060+0000", 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127799 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.696305+0000", 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012449959999999999 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702748+0000", 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064427699999999996 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702776+0000", 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059e-05 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702799+0000", 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2510999999999998e-05 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:24.332 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:24.334 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:24.334 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:24.351+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:24.435 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:24.452+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:24.445 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:24.445 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:24.445 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:24.445 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:24.454 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:24.536 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:24.553+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:24.562 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:24.562 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:24.562 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:24.562 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:24.562 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:24.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:24.636 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:24.653+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:24.721 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:24.721 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 118.667989742, 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:24.722 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 118.667908254, 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:24.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:24.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:24.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.869816563, 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:24.738 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.869768573, 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.740 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.744 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86973027400001, 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:24.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86969148599999, 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.750 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:24.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:24.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:24.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:24.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.755 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.869668155, 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:24.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:24.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:24.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:24.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86963767, 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.761 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:24.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:24.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:24.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.869602601, 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.767 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:24.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:24.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.869578858, 2024-04-15T23:33:24.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:24.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:24.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86952626, 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.778 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:24.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:24.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86948746100001, 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:24.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.786 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86945229, 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.789 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.794 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86941892199999, 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.796 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:24.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:24.799 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.869361461, 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:24.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:24.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86772580100001, 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:24.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:24.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:24.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:24.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.86683426899999, 2024-04-15T23:33:24.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:24.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:24.815 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 113.866744805, 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:24.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:24.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.459804295000001, 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.820 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.824 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:24.825 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 18.459068944999999, 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.826 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:24.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:24.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:24.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:24.831 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:24.833 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:24.850+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:24.833 INFO:tasks.workunit.client.0.smithi102.stdout: [DEP] 2024-04-15T23:33:24.833 INFO:tasks.workunit.client.0.smithi102.stdout: [DEP] 2024-04-15T23:33:24.833 INFO:tasks.workunit.client.0.smithi102.stdout: [DEP] 2024-04-15T23:33:24.834 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:24.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:24.933 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:24.950+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:24.946 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:24.946 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:24.946 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:24.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:25.039 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:25.056+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:25.042 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:25.042 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:25.068 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:25.068 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:25.072 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:25.072 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:25.103 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.103 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.112 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:25.135 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:25.152+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:25.235 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:25.252+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.261 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:25.292 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] dirstress 2024-04-15T23:33:25.300 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] fill 2024-04-15T23:33:25.300 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] fill2 2024-04-15T23:33:25.303 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] getpagesize 2024-04-15T23:33:25.336 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:25.353+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:25.380 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.380 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.389 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:25.419 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-15T23:33:25.473 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:25.490+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:25.517 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] holes 2024-04-15T23:33:25.537 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:25.554+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:25.538 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.538 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.542 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] lstat64 2024-04-15T23:33:25.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:25.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~71s 2024-04-15T23:33:25.638 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:25.655+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:25.643 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] nametest 2024-04-15T23:33:25.652 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] permname 2024-04-15T23:33:25.696 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.696 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:25.749 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:25.766+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:25.814 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.814 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:25.826 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] randholes 2024-04-15T23:33:25.831 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] runas 2024-04-15T23:33:25.840 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:25.857+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:25.941 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:25.958+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:25.970 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:25.970 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:25.972 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] truncfile 2024-04-15T23:33:25.979 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:26.014 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] usemem 2024-04-15T23:33:26.042 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.059+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.086 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.086 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.087 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] mmapcat 2024-04-15T23:33:26.095 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:26.143 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.161+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.182 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] append_reader 2024-04-15T23:33:26.206 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.206 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:26.238 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] append_writer 2024-04-15T23:33:26.245 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.262+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.254 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] dirperf 2024-04-15T23:33:26.303 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] metaperf 2024-04-15T23:33:26.323 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.323 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:26.345 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.362+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.416 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] devzero 2024-04-15T23:33:26.417 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is set 2024-04-15T23:33:26.441 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.441 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.446 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:26.462+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:26.451 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:26.468 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] feature 2024-04-15T23:33:26.546 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:26.564+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:26.562 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.562 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:26.584 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] alloc 2024-04-15T23:33:26.647 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.664+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.680 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.680 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.680 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] fault 2024-04-15T23:33:26.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:26.694 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] fstest 2024-04-15T23:33:26.773 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.790+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.785 INFO:tasks.workunit.client.0.smithi102.stdout: [CC] t_access_root 2024-04-15T23:33:26.790 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c: In function 'main': 2024-04-15T23:33:26.790 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-04-15T23:33:26.790 INFO:tasks.workunit.client.0.smithi102.stderr: 154 | bozo! 2024-04-15T23:33:26.790 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~ 2024-04-15T23:33:26.790 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-04-15T23:33:26.790 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr: 154 | bozo! 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr: | ^ 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr: | ; 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr: 184 | rflag = 1; 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~ 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr: | nflag 2024-04-15T23:33:26.791 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-04-15T23:33:26.792 INFO:tasks.workunit.client.0.smithi102.stderr: 320 | bozo! 2024-04-15T23:33:26.792 INFO:tasks.workunit.client.0.smithi102.stderr: | ^ 2024-04-15T23:33:26.792 INFO:tasks.workunit.client.0.smithi102.stderr: | ; 2024-04-15T23:33:26.792 INFO:tasks.workunit.client.0.smithi102.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-04-15T23:33:26.792 INFO:tasks.workunit.client.0.smithi102.stderr: 128 | struct flock64 f; 2024-04-15T23:33:26.792 INFO:tasks.workunit.client.0.smithi102.stderr: | ^ 2024-04-15T23:33:26.794 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-04-15T23:33:26.794 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-04-15T23:33:26.838 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.838 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:26.848 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:26.865+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c: In function 'run_child': 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~ 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~ 2024-04-15T23:33:26.916 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~ 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~ 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-04-15T23:33:26.917 INFO:tasks.workunit.client.0.smithi102.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-15T23:33:26.948 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:26.966+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:26.957 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:26.957 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:26.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:26.999 INFO:tasks.workunit.client.0.smithi102.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-04-15T23:33:26.999 INFO:tasks.workunit.client.0.smithi102.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-04-15T23:33:27.000 INFO:tasks.workunit.client.0.smithi102.stderr:make: *** [Makefile:51: default] Error 2 2024-04-15T23:33:27.001 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-15T23:33:27.001 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-04-15T23:33:27.001 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-15T23:33:27.050 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:27.066+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:27.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:27.074 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:27.074 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:27.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:27.151 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:27.168+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:27.210 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:27.210 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:27.228 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:27.229 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:27.229 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:27.232 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:27.232 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.179144708, 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:27.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:27.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.237 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:27.238 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.17906322, 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:27.239 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:27.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:27.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.38097152899999, 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.246 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.38092353899999, 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.250 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.255 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.38088524, 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.260 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380846452, 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:27.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:27.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:27.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:27.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.265 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:27.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.267 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.38082312100001, 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:27.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380792636, 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.273 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.275 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.278 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380757567, 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:27.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.283 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380733824, 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.284 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:27.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.38068122599999, 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.289 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:27.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.293 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.294 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380642427, 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380607256, 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.300 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:27.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.305 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380573888, 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:27.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.380516427, 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.311 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.315 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.378880767, 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.377989235, 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:27.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:27.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:27.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.325 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 116.377899771, 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:27.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:27.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:27.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.970959261000001, 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.330 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:27.334 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 20.970223911000001, 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:27.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:27.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:27.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:27.339 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:27.341 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:27.342 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:27.342 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:27.357+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:27.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:27.343 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi102 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-04-15T23:33:27.611 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d56dcf190b424200972d8a716d4e4f69 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_461a84e6fbbf089011eafd13b98169fb9e9b8cc9/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi102 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-04-15T23:33:27.614 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-15T23:33:27.624 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-15T23:33:27.625 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:33:27.625 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T23:33:27.630 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:27.647+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:27.646 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:33:27.646 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T23:33:27.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:33:27.731 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:27.748+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:27.741 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:27.742 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:27.742 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:27.742 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:27.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:27.834 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:27.851+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:27.899 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:27.900 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:27.900 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:27.900 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:27.900 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:27.909 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:27.933 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:27.950+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:28.028 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:33:28.028 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":52,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:33:26.429284+0000","last_up_change":"2024-04-15T23:32:10.524116+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5800000429153442,"score_stable":1.5800000429153442,"optimal_score":0.67000001668930054,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":23}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.9","osds":[0,1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:33:28.033 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:28.051+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:28.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T23:33:28.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T23:33:28.059 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:28.059 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:28.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:28.059 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:28.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.059 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 117.206865627, 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:28.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.068 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 117.20680888299999, 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:28.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:28.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:28.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:28.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:28.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 117.20669772700001, 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:28.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:28.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:28.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:28.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 117.206610713, 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:28.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:28.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 117.206344255, 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.097 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:28.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:28.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:28.106 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 117.206303756, 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:28.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:28.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:28.113 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.870665052, 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:28.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:28.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:28.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.542551099000001, 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.122 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:28.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:28.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.130 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.178685506000001, 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:28.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:28.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.174415477, 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:28.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:28.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:28.147 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.451514019000001, 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:28.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:28.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:28.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:28.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.385361334999999, 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:28.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:28.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:28.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:28.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.385351328999999, 2024-04-15T23:33:28.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:28.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:28.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.173 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.385338417, 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:28.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:28.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.379440431999999, 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:28.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:28.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:28.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.191 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.378231320000001, 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:28.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:28.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:28.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.911289358000001, 2024-04-15T23:33:28.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:28.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:28.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:28.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3028 3.0 3:02ac1934:::200.00000009:head [write 1110102~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:28.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.385133514, 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012674134, 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689826+0000", 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5659999999999999e-05 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689827+0000", 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6649999999999999e-06 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689830+0000", 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.101e-06 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689833+0000", 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6450000000000001e-06 2024-04-15T23:33:28.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693747+0000", 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039136010000000001 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693821+0000", 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3831999999999994e-05 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693945+0000", 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012467500000000001 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695419+0000", 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014735830000000001 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702324+0000", 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069050140000000001 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702413+0000", 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345000000000006e-05 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702484+0000", 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1013000000000006e-05 2024-04-15T23:33:28.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3029 3.0 3:02ac1934:::200.00000009:head [write 1111504~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.385101841000001, 2024-04-15T23:33:28.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862877, 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:28.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5800000000000001e-07 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689847+0000", 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5929999999999999e-06 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689850+0000", 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6150000000000001e-06 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689853+0000", 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9519999999999999e-06 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694528+0000", 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004674648 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694574+0000", 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5729999999999998e-05 2024-04-15T23:33:28.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694641+0000", 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7378000000000004e-05 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695426+0000", 2024-04-15T23:33:28.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078491800000000001 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702611+0000", 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071851559999999998 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702665+0000", 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.384e-05 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702705+0000", 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9789000000000001e-05 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3030 3.0 3:02ac1934:::200.00000009:head [write 1112906~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.385086291, 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012941556, 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:28.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689858+0000", 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.79e-07 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689859+0000", 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6080000000000001e-06 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689862+0000", 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9919999999999999e-06 2024-04-15T23:33:28.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689865+0000", 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5799999999999999e-06 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694860+0000", 2024-04-15T23:33:28.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049954470000000001 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694933+0000", 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2515000000000006e-05 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:28.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695060+0000", 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127799 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.696305+0000", 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012449959999999999 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702748+0000", 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064427699999999996 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702776+0000", 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059e-05 2024-04-15T23:33:28.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702799+0000", 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2510999999999998e-05 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:28.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:28.236 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:28.237 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:28.238 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:28.254+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:28.329 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-04-15T23:33:28.337 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:28.354+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:28.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-15T23:33:28.357 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:28.357 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:28.357 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:28.357 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:28.366 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:28.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-15T23:33:28.451 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:28.468+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:28.514 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:28.515 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:28.515 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:28.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:28.538 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:28.556+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:28.639 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:28.656+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:28.647 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 8 2024-04-15T23:33:28.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T23:33:28.673 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:28.673 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:28.673 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:28.673 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:28.673 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.673 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 122.61944786799999, 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:28.674 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.675 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:28.676 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.677 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.678 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:28.679 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.680 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.681 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 122.61936638, 2024-04-15T23:33:28.683 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:28.684 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.685 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:28.686 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:28.687 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.688 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.689 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.690 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.691 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:28.692 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.82127468900001, 2024-04-15T23:33:28.693 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.694 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.695 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.696 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:28.697 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.698 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.699 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:28.700 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.701 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.702 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.82122669899999, 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.703 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.704 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.706 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:28.707 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.708 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.709 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:28.710 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.711 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.8211884, 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.712 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.713 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.714 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:28.715 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.716 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.717 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:28.718 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.719 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.720 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.821149612, 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.721 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.722 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:28.723 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.724 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.725 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:28.726 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.727 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.728 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:28.729 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.82112628100001, 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:28.730 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.731 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:28.732 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.733 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:28.734 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:28.735 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.736 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:28.737 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.738 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.739 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.82109579599999, 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.740 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.741 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.742 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.743 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:28.744 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.745 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.746 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:28.747 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.748 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.821060727, 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.749 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.750 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.751 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:28.752 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.753 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.754 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:28.755 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.756 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:28.757 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.821036984, 2024-04-15T23:33:28.758 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.759 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.760 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.761 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:28.762 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.763 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.764 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:28.765 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.766 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.767 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.82098438600001, 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:28.772 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.773 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.774 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:28.775 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.776 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.820945587, 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.777 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.778 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:28.779 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.780 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.781 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:28.782 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.783 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:28.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:28.785 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.786 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.820910416, 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.787 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:28.788 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.789 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:28.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:28.791 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.792 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:28.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.794 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.795 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.820877048, 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.796 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.797 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:28.798 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.799 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:28.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:28.801 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.802 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.803 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:28.804 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:28.805 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.820819587, 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:28.806 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.807 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.808 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:28.809 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.810 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:28.811 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.812 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.813 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.814 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.819183927, 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.815 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.816 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.817 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:28.818 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.819 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.820 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:28.821 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.822 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:28.823 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.818292395, 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:28.824 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:28.825 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.826 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.827 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:28.828 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.829 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:28.830 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.831 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.832 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.833 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 117.818202931, 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.834 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:28.835 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.836 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:28.837 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.838 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:28.839 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.840 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.411262421, 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.841 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.842 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:28.843 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.844 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:28.845 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.846 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:28.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:28.848 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 22.410527071000001, 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:28.850 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.851 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:28.852 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.853 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.854 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:28.855 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.856 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:28.857 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:28.858 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:28.860 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:28.877+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:28.860 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:28.950 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-04-15T23:33:28.961 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:28.977+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:28.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T23:33:28.981 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:28.981 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:28.981 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-15T23:33:28.981 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:28.990 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:29.074 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:29.091+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:29.139 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:29.140 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-15T23:33:29.140 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-15T23:33:29.140 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-15T23:33:29.140 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:29.147 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:29.163 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:29.180+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:29.250 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-04-15T23:33:29.263 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T23:33:29.264 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:29.280+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:29.295 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-15T23:33:29.295 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.44353599999999, 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012767171000000001, 2024-04-15T23:33:29.296 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868078+0000", 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868081+0000", 2024-04-15T23:33:29.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2990000000000001e-06 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868088+0000", 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4999999999999996e-06 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868097+0000", 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5740000000000002e-06 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868110+0000", 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.307e-05 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868272+0000", 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016143599999999999 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868450+0000", 2024-04-15T23:33:29.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017801000000000001 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868595+0000", 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537600000000001 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870137+0000", 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001541466 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880760+0000", 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010622862 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880800+0000", 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0720000000000003e-05 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880845+0000", 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4858000000000003e-05 2024-04-15T23:33:29.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.443479256, 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012915261000000001, 2024-04-15T23:33:29.305 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868135+0000", 2024-04-15T23:33:29.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2e-07 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868138+0000", 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.185e-06 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868161+0000", 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2484e-05 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868167+0000", 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1090000000000003e-06 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868997+0000", 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00082988400000000003 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869086+0000", 2024-04-15T23:33:29.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9586999999999995e-05 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118732 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870198+0000", 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00099323500000000008 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880892+0000", 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010694041 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880979+0000", 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7046999999999995e-05 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881050+0000", 2024-04-15T23:33:29.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0437000000000003e-05 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:29.314 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.4433681, 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01275129, 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:29.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868246+0000", 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868247+0000", 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2869999999999999e-06 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868263+0000", 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5603e-05 2024-04-15T23:33:29.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868279+0000", 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6721000000000001e-05 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868292+0000", 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2884000000000001e-05 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869003+0000", 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00071087600000000004 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869114+0000", 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110375 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869205+0000", 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1582000000000005e-05 2024-04-15T23:33:29.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870193+0000", 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0009874599999999999 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880853+0000", 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010659923 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880945+0000", 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2033999999999993e-05 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.880997+0000", 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2544999999999999e-05 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:29.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.443281086, 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862589000000001, 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868333+0000", 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868334+0000", 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4399999999999999e-07 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868339+0000", 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.203e-06 2024-04-15T23:33:29.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868347+0000", 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2069999999999995e-06 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868355+0000", 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5469999999999999e-06 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869560+0000", 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012054629999999999 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869633+0000", 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2576000000000004e-05 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869761+0000", 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128639 2024-04-15T23:33:29.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870455+0000", 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069358400000000002 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881099+0000", 2024-04-15T23:33:29.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010644147 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881151+0000", 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1459000000000003e-05 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881195+0000", 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4919999999999997e-05 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:29.332 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.443014628, 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012830396000000001, 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868599+0000", 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868600+0000", 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6199999999999997e-07 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868612+0000", 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2463000000000001e-05 2024-04-15T23:33:29.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868622+0000", 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6670000000000008e-06 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868629+0000", 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7410000000000003e-06 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869572+0000", 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00094327500000000004 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869685+0000", 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112786 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.869802+0000", 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116617 2024-04-15T23:33:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.870460+0000", 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065836099999999999 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881161+0000", 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010700648 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881389+0000", 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000228421 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.881430+0000", 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0754999999999999e-05 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:29.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.44297412900001, 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010916510000000001, 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868640+0000", 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868641+0000", 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868643+0000", 2024-04-15T23:33:29.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9249999999999999e-06 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868651+0000", 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7489999999999998e-06 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868658+0000", 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1280000000000002e-06 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868721+0000", 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2268999999999996e-05 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.868864+0000", 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014312099999999999 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:31:30.879556+0000", 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01069261 2024-04-15T23:33:29.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:28 4.2e 4:74d13cfc:::1000000021c.00000000:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.107335424999999, 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014272775999999999, 2024-04-15T23:33:29.348 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 28 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.204279+0000", 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8899999999999998e-07 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209906+0000", 2024-04-15T23:33:29.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056267180000000002 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209922+0000", 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6257999999999999e-05 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.209949+0000", 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6214e-05 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210221+0000", 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027269399999999997 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.210342+0000", 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120876 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218424+0000", 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080812799999999997 2024-04-15T23:33:29.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218469+0000", 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024000000000001e-05 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:03.218551+0000", 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2723000000000001e-05 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4200 4.28 4:17d90427:::10000001290.00000000:head [write 0~1007] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:29.356 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.779221472, 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011370620999999999, 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:29.357 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4200 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532392+0000", 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532393+0000", 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2399999999999997e-07 2024-04-15T23:33:29.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532397+0000", 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8539999999999999e-06 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532407+0000", 2024-04-15T23:33:29.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023999999999999e-05 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.532415+0000", 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6020000000000002e-06 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533519+0000", 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011042910000000001 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.533596+0000", 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6914000000000003e-05 2024-04-15T23:33:29.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543629+0000", 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010033073 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543689+0000", 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9629000000000001e-05 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:07.543763+0000", 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4510000000000003e-05 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.364 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:133 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.415355879, 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015903703000000002, 2024-04-15T23:33:29.365 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896258+0000", 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.896259+0000", 2024-04-15T23:33:29.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0070000000000001e-06 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901128+0000", 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048687879999999998 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901137+0000", 2024-04-15T23:33:29.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8929999999999994e-06 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901141+0000", 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7450000000000003e-06 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901180+0000", 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8483999999999999e-05 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.901250+0000", 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0195000000000001e-05 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912082+0000", 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010831759 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912121+0000", 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9292999999999998e-05 2024-04-15T23:33:29.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.912162+0000", 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0538999999999999e-05 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4525.0:4902 4.19 4:99d64ffc:::1000000155f.00000000:head [write 0~2178] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.411085849999999, 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011269065, 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.373 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4525", 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4902 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900528+0000", 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900529+0000", 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8400000000000003e-07 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900538+0000", 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4059999999999994e-06 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900549+0000", 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0648999999999999e-05 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900557+0000", 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-04-15T23:33:29.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900606+0000", 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8405000000000002e-05 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.900701+0000", 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5037999999999994e-05 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911678+0000", 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010977288999999999 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911724+0000", 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6177000000000002e-05 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:09.911797+0000", 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2856999999999997e-05 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.380 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:454 3.1e 3:7bf7e7b5:::200.00000006:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.688184392, 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016160291, 2024-04-15T23:33:29.381 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.623430+0000", 2024-04-15T23:33:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3499999999999995e-07 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627371+0000", 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003941061 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627382+0000", 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0956e-05 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627387+0000", 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8119999999999998e-06 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627425+0000", 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8393000000000003e-05 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.627505+0000", 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9628000000000004e-05 2024-04-15T23:33:29.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639511+0000", 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012005824999999999 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639545+0000", 2024-04-15T23:33:29.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3649000000000003e-05 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.639590+0000", 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5232000000000003e-05 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:468 3.1d 3:bec1251c:::200.00000007:head [write 179091~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.622031708000002, 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012849385, 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689582+0000", 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2499999999999999e-07 2024-04-15T23:33:29.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689584+0000", 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.48e-06 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689587+0000", 2024-04-15T23:33:29.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9330000000000001e-06 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689589+0000", 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.542e-06 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695447+0000", 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058575579999999997 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695487+0000", 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0351e-05 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695556+0000", 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8423000000000005e-05 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697078+0000", 2024-04-15T23:33:29.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015221169999999999 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702340+0000", 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052624309999999997 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702388+0000", 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7644e-05 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702432+0000", 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3680999999999997e-05 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.397 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:469 3.1d 3:bec1251c:::200.00000007:head [write 180494~1401 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.622021702000001, 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012962285, 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.398 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689592+0000", 2024-04-15T23:33:29.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.16e-07 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689596+0000", 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7129999999999999e-06 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689599+0000", 2024-04-15T23:33:29.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2200000000000001e-06 2024-04-15T23:33:29.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689602+0000", 2024-04-15T23:33:29.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5809999999999999e-06 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695902+0000", 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062997770000000003 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695940+0000", 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8120000000000001e-05 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696001+0000", 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1156999999999997e-05 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.697717+0000", 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001716394 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702473+0000", 2024-04-15T23:33:29.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047557449999999996 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702521+0000", 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8106000000000003e-05 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702555+0000", 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3256000000000001e-05 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:470 3.1d 3:bec1251c:::200.00000007:head [write 181895~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.407 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.622008789999999, 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013056112999999999, 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689605+0000", 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1400000000000001e-07 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689607+0000", 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7549999999999999e-06 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689610+0000", 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9679999999999998e-06 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.689613+0000", 2024-04-15T23:33:29.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.48e-06 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696200+0000", 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065873349999999997 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696238+0000", 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7827999999999998e-05 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696297+0000", 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8922999999999998e-05 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698054+0000", 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001757759 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702589+0000", 2024-04-15T23:33:29.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045348960000000001 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702642+0000", 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2315999999999999e-05 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702661+0000", 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9639e-05 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:476 3.1d 3:bec1251c:::200.00000007:head [write 212845~9088 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:29.416 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.616110805000002, 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012855873, 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695503+0000", 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695504+0000", 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.37e-07 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695513+0000", 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0289999999999994e-06 2024-04-15T23:33:29.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695520+0000", 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3180000000000001e-06 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.695525+0000", 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5709999999999999e-06 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698350+0000", 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028255060000000002 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698390+0000", 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9535e-05 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698459+0000", 2024-04-15T23:33:29.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9139000000000003e-05 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702772+0000", 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043129249999999996 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708289+0000", 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055176790000000002 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708319+0000", 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9764000000000002e-05 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708359+0000", 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.977e-05 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:477 3.1d 3:bec1251c:::200.00000007:head [write 221933~9670 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.614901693, 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011739529, 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696712+0000", 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696713+0000", 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0400000000000005e-07 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696723+0000", 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6760000000000002e-06 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696733+0000", 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0152999999999999e-05 2024-04-15T23:33:29.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.696739+0000", 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.767e-06 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698728+0000", 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019898540000000001 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698768+0000", 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0006000000000003e-05 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.698829+0000", 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0683999999999997e-05 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.702777+0000", 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039480319999999998 2024-04-15T23:33:29.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708394+0000", 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056172239999999997 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708421+0000", 2024-04-15T23:33:29.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6648e-05 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:10.708452+0000", 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0681e-05 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:1235 3.1d 3:bec1251c:::200.00000007:head [write 271302~3923002 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e46)", 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.147959731, 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015207846000000001, 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163654+0000", 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.163655+0000", 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9599999999999999e-07 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167218+0000", 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035627329999999998 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167231+0000", 2024-04-15T23:33:29.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3370000000000001e-05 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167238+0000", 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4699999999999996e-06 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167286+0000", 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7719999999999997e-05 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167354+0000", 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7677999999999998e-05 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.167422+0000", 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8373000000000004e-05 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178103+0000", 2024-04-15T23:33:29.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010680876000000001 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178813+0000", 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00070944699999999999 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178842+0000", 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9062999999999999e-05 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:11.178862+0000", 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0420000000000001e-05 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3028 3.0 3:02ac1934:::200.00000009:head [write 1110102~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.621803887, 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012674134, 2024-04-15T23:33:29.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689810+0000", 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689826+0000", 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5659999999999999e-05 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689827+0000", 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6649999999999999e-06 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689830+0000", 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.101e-06 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689833+0000", 2024-04-15T23:33:29.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6450000000000001e-06 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693747+0000", 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039136010000000001 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693821+0000", 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3831999999999994e-05 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.693945+0000", 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012467500000000001 2024-04-15T23:33:29.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695419+0000", 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014735830000000001 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702324+0000", 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069050140000000001 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702413+0000", 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345000000000006e-05 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702484+0000", 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1013000000000006e-05 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3029 3.0 3:02ac1934:::200.00000009:head [write 1111504~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.621772214, 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012862877, 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:29.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689842+0000", 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5800000000000001e-07 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689847+0000", 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5929999999999999e-06 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689850+0000", 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6150000000000001e-06 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689853+0000", 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9519999999999999e-06 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694528+0000", 2024-04-15T23:33:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004674648 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694574+0000", 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5729999999999998e-05 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694641+0000", 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7378000000000004e-05 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695426+0000", 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078491800000000001 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702611+0000", 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071851559999999998 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702665+0000", 2024-04-15T23:33:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.384e-05 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702705+0000", 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9789000000000001e-05 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:3030 3.0 3:02ac1934:::200.00000009:head [write 1112906~1402 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e48)", 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.621756663999999, 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012941556, 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-15T23:33:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689857+0000", 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689858+0000", 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.79e-07 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689859+0000", 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6080000000000001e-06 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689862+0000", 2024-04-15T23:33:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9919999999999999e-06 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.689865+0000", 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5799999999999999e-06 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694860+0000", 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049954470000000001 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.694933+0000", 2024-04-15T23:33:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2515000000000006e-05 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.695060+0000", 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127799 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-15T23:33:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.696305+0000", 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012449959999999999 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702748+0000", 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064427699999999996 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702776+0000", 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8059e-05 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-15T23:33:15.702799+0000", 2024-04-15T23:33:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2510999999999998e-05 2024-04-15T23:33:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-15T23:33:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-15T23:33:29.472 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-15T23:33:29.472 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-15T23:33:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is set 2024-04-15T23:33:29.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:29.476 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:29.491+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:29.575 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:29.592+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:29.577 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2024-04-15T23:33:29.590 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:29.591 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:29.591 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:29.591 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:29.592 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-04-15T23:33:29.592 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-15T23:33:29.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:29.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:33:29.641 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:29.641 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:29.661 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:29.661 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:29.661 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:29.665 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:29.665 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:29.675 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:29.692+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:29.708 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:29.708 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:29.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:29.803 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:29.820+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:29.868 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:29.869 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:29.877 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:29.918 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:29.935+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:29.928 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:33:29.928 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":53,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:33:29.438211+0000","last_up_change":"2024-04-15T23:32:10.524116+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":0.67000001668930054,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5800000429153442,"score_stable":1.5800000429153442,"optimal_score":0.67000001668930054,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6801","nonce":1544615186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6803","nonce":1544615186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6807","nonce":1544615186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1544615186},{"type":"v1","addr":"172.21.15.115:6805","nonce":1544615186}]},"public_addr":"172.21.15.115:6801/1544615186","cluster_addr":"172.21.15.115:6803/1544615186","heartbeat_back_addr":"172.21.15.115:6807/1544615186","heartbeat_front_addr":"172.21.15.115:6805/1544615186","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6801","nonce":2023242123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6803","nonce":2023242123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6807","nonce":2023242123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":2023242123},{"type":"v1","addr":"172.21.15.195:6805","nonce":2023242123}]},"public_addr":"172.21.15.195:6801/2023242123","cluster_addr":"172.21.15.195:6803/2023242123","heartbeat_back_addr":"172.21.15.195:6807/2023242123","heartbeat_front_addr":"172.21.15.195:6805/2023242123","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":23}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.9","osds":[0,1]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:33:29.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-15T23:31:23.797113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-15T23:31:23.948719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-15T23:31:28.382708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-15T23:31:29.186157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5800000429153442, 'score_stable': 1.5800000429153442, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-15T23:33:29.942 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-15T23:33:29.979 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:29.996+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:29.986 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:29.986 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:29.994 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:30.079 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:30.096+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:30.103 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.103 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.112 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:30.181 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:30.197+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:30.229 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-04-15T23:33:30.243 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-15T23:33:30.260 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.260 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.270 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:30.281 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:30.298+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:30.379 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.380 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.382 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:30.399+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:30.388 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:30.483 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:30.500+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:30.495 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.495 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.504 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:30.537 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 8 2024-04-15T23:33:30.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-15T23:33:30.584 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:30.601+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:30.653 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.653 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.661 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:30.706 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:30.723+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:30.772 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.772 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.781 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:30.822 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:30.839+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:30.837 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-04-15T23:33:30.850 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-15T23:33:30.886 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:30.904+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:30.929 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:30.929 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:30.938 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:30.987 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:31.004+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:31.046 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.046 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:31.096 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:31.113+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:31.137 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-04-15T23:33:31.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-15T23:33:31.163 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.163 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:31.215 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:31.232+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:31.278 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.279 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:31.290 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:31.308+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:31.391 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:31.408+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:31.435 INFO:teuthology.orchestra.run.smithi115.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.436 INFO:teuthology.orchestra.run.smithi115.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~77s 2024-04-15T23:33:31.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-15T23:33:31.448 INFO:teuthology.orchestra.run.smithi102.stderr:listed 0 entries 2024-04-15T23:33:31.461 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi102.front.sepia.ceph.com... 2024-04-15T23:33:31.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:33:31.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-15T23:33:31.477 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:33:31.489 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi102.stderr:ceph-fuse[34209]: fuse finished with error 0 and tester_r 0 2024-04-15T23:33:31.492 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:31.509+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:31.497 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:33:31.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-04-15T23:33:31.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:33:31.552 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-15T23:33:31.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:33:31.567 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-04-15T23:33:31.570 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.570 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.579 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-15T23:33:31.592 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:31.609+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:31.622 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-15T23:33:31.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:33:31.623 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-15T23:33:31.666 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-15T23:33:31.686 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.686 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-15T23:33:31.693 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-04-15T23:33:31.694 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-04-15T23:33:31.709+0000 7f9e939b0640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 31301) UID: 0 2024-04-15T23:33:31.695 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-15T23:33:31.794 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-15T23:33:31.803 INFO:tasks.thrashosds:joining thrashosds 2024-04-15T23:33:31.804 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:33:31.811+0000 7f14583f2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 31323) UID: 0 2024-04-15T23:33:31.843 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-15T23:33:31.843 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-15T23:33:31.852 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:33:31.862 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0: {} 2024-04-15T23:33:31.862 INFO:teuthology.orchestra.run.smithi102.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-15T23:33:31.880 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1: {} 2024-04-15T23:33:31.880 INFO:teuthology.orchestra.run.smithi102.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-15T23:33:31.881 INFO:teuthology.orchestra.run.smithi102.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-15T23:33:31.884 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-15T23:33:31.884 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-15T23:33:31.962 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:31.962 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:31.962 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:33:31.962 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:31.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-15T23:33:32.079 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:32.079 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:33:32.079 INFO:teuthology.orchestra.run.smithi115.stdout: "complaint_time": 30, 2024-04-15T23:33:32.079 INFO:teuthology.orchestra.run.smithi115.stdout: "num_blocked_ops": 0 2024-04-15T23:33:32.079 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:32.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-15T23:33:32.197 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:33:32.197 INFO:teuthology.orchestra.run.smithi115.stdout: "size": 20, 2024-04-15T23:33:32.197 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 600, 2024-04-15T23:33:32.197 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [ 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 126.14337926100001, 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013229807, 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.198 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 164 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.199 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069432+0000", 2024-04-15T23:33:32.200 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069433+0000", 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.4499999999999997e-07 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.201 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069484+0000", 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1214000000000001e-05 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069493+0000", 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.8710000000000003e-06 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.202 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069500+0000", 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5930000000000002e-06 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073893+0000", 2024-04-15T23:33:32.203 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043931170000000002 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.073939+0000", 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6610999999999998e-05 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.204 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.074013+0000", 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.3579999999999997e-05 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076612+0000", 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002599353 2024-04-15T23:33:32.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082597+0000", 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059846350000000003 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082627+0000", 2024-04-15T23:33:32.206 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0292999999999999e-05 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082662+0000", 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4894999999999997e-05 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.207 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4147.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 126.143297773, 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013231477, 2024-04-15T23:33:32.208 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4147", 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "172.21.15.102:0/2055089589", 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 165 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.209 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.210 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069514+0000", 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069515+0000", 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:32.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069518+0000", 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.6950000000000002e-06 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.212 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069526+0000", 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.6639999999999998e-06 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.069531+0000", 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8590000000000004e-06 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.213 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.214 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.214 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076128+0000", 2024-04-15T23:33:32.214 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065972399999999999 2024-04-15T23:33:32.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.214 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076174+0000", 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6099e-05 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076242+0000", 2024-04-15T23:33:32.215 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8190999999999998e-05 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.076724+0000", 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00048158400000000002 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.216 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082694+0000", 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0059698119999999997 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082723+0000", 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.9607e-05 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.217 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:26.082745+0000", 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2101000000000001e-05 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.218 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:5 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.345206082, 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015914437, 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.219 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867606+0000", 2024-04-15T23:33:32.220 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867607+0000", 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5719999999999999e-06 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.221 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867615+0000", 2024-04-15T23:33:32.222 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4749999999999996e-06 2024-04-15T23:33:32.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.222 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.222 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.222 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867625+0000", 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0755e-05 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867636+0000", 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1012999999999999e-05 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.223 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874615+0000", 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0069787870000000002 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874786+0000", 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017062199999999999 2024-04-15T23:33:32.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874928+0000", 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000141765 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883010+0000", 2024-04-15T23:33:32.225 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.008082344 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883424+0000", 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041440699999999999 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.226 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883482+0000", 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7435999999999997e-05 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883520+0000", 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.8260999999999998e-05 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.227 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:6 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34515809200001, 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017152536999999999, 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.228 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.229 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867654+0000", 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.6899999999999996e-07 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.230 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867668+0000", 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.3186e-05 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867676+0000", 2024-04-15T23:33:32.231 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3329999999999997e-06 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867682+0000", 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9070000000000004e-06 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.232 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876466+0000", 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087842500000000004 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876610+0000", 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000144244 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.233 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876832+0000", 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00022158400000000001 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883561+0000", 2024-04-15T23:33:32.234 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067290609999999997 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884714+0000", 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00115259 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.235 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884758+0000", 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4245000000000001e-05 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884806+0000", 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8267999999999999e-05 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.236 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34511979299999, 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017272115000000001, 2024-04-15T23:33:32.237 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.238 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867692+0000", 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867693+0000", 2024-04-15T23:33:32.239 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1099999999999995e-07 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867707+0000", 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.4877e-05 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.240 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867715+0000", 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5390000000000002e-06 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867721+0000", 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9020000000000004e-06 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.241 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879590+0000", 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011869497 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879755+0000", 2024-04-15T23:33:32.242 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016465100000000001 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880168+0000", 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041329399999999998 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.243 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884701+0000", 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0045325139999999996 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884872+0000", 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017153700000000001 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.244 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884929+0000", 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6243999999999999e-05 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884964+0000", 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5349000000000003e-05 2024-04-15T23:33:32.245 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:9 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:32.246 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.345081005, 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017292065999999998, 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:32.247 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.248 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867731+0000", 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.37e-07 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867735+0000", 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2820000000000001e-06 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.249 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867741+0000", 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9730000000000002e-06 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.250 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867746+0000", 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2839999999999997e-06 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880520+0000", 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012773691 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.251 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880633+0000", 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011314700000000001 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.880785+0000", 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000152435 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.252 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884853+0000", 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0040681679999999996 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884974+0000", 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120747 2024-04-15T23:33:32.253 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885002+0000", 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8144e-05 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.254 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885023+0000", 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0458e-05 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.255 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.345057674, 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017395847999999998, 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.256 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867754+0000", 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.257 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867755+0000", 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1799999999999995e-07 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867758+0000", 2024-04-15T23:33:32.258 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1070000000000001e-06 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867764+0000", 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.1759999999999998e-06 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.259 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867770+0000", 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2949999999999999e-06 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881302+0000", 2024-04-15T23:33:32.260 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013531899 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881386+0000", 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.3745999999999994e-05 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.261 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881506+0000", 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120068 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885070+0000", 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0035644330000000001 2024-04-15T23:33:32.262 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885106+0000", 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.5327000000000002e-05 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.263 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885131+0000", 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.5058999999999998e-05 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885150+0000", 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.9219999999999999e-05 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.264 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:11 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34502718900001, 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.017424373999999999, 2024-04-15T23:33:32.265 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.266 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867784+0000", 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.267 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867785+0000", 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3200000000000005e-07 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867795+0000", 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.042e-05 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.268 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867803+0000", 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-06 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.269 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867810+0000", 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.1579999999999999e-06 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882496+0000", 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014686322 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.270 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882659+0000", 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016298800000000001 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.271 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882780+0000", 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000120437 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885094+0000", 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0023144620000000002 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.272 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885157+0000", 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3058000000000005e-05 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885188+0000", 2024-04-15T23:33:32.273 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1080000000000001e-05 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885209+0000", 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.0647000000000001e-05 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.274 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34499212, 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020352017, 2024-04-15T23:33:32.275 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.276 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.277 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867820+0000", 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2500000000000005e-07 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867823+0000", 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0400000000000001e-06 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867830+0000", 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.5039999999999999e-06 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867836+0000", 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3069999999999999e-06 2024-04-15T23:33:32.279 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883703+0000", 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015866913 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883798+0000", 2024-04-15T23:33:32.280 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.5169999999999999e-05 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883907+0000", 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000108403 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.281 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885226+0000", 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001319146 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888101+0000", 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.002875496 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.282 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888141+0000", 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.9532e-05 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888172+0000", 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.0781000000000002e-05 2024-04-15T23:33:32.283 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.344968377, 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.020425819000000001, 2024-04-15T23:33:32.284 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.285 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867843+0000", 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867844+0000", 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0800000000000004e-07 2024-04-15T23:33:32.286 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867847+0000", 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2909999999999999e-06 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.287 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867855+0000", 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.7680000000000008e-06 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867861+0000", 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.9549999999999997e-06 2024-04-15T23:33:32.288 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.016300592999999999 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884237+0000", 2024-04-15T23:33:32.289 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.5145e-05 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884430+0000", 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019322499999999999 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.290 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.885296+0000", 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00086562900000000003 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888207+0000", 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0029117079999999998 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.291 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888241+0000", 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3810999999999999e-05 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.888269+0000", 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.7985999999999999e-05 2024-04-15T23:33:32.292 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.344915779, 2024-04-15T23:33:32.293 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015223179, 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.294 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867896+0000", 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.1399999999999997e-07 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867900+0000", 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.1769999999999998e-06 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.296 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867908+0000", 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.1009999999999992e-06 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867925+0000", 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.7456e-05 2024-04-15T23:33:32.297 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874972+0000", 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007046381 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.298 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875062+0000", 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0807e-05 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875226+0000", 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00016393899999999999 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.299 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882387+0000", 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0071604199999999998 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883009+0000", 2024-04-15T23:33:32.300 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00062271899999999999 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883067+0000", 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.7346000000000003e-05 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.301 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883119+0000", 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.2318999999999998e-05 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.302 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34487698, 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01407797, 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.303 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.304 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867935+0000", 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3300000000000002e-07 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867944+0000", 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0589999999999992e-06 2024-04-15T23:33:32.305 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867951+0000", 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9600000000000003e-06 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867961+0000", 2024-04-15T23:33:32.306 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.7960000000000007e-06 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.874861+0000", 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0068999179999999997 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.307 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875009+0000", 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000148092 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875144+0000", 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000134902 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.308 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881698+0000", 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0065535940000000003 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881742+0000", 2024-04-15T23:33:32.309 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4153000000000002e-05 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881938+0000", 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00019660599999999999 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.310 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882013+0000", 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.4257000000000004e-05 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.311 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.344841809, 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014512946000000001, 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.312 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867970+0000", 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867971+0000", 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9999999999999997e-07 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.314 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867973+0000", 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.8629999999999999e-06 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867981+0000", 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2649999999999999e-06 2024-04-15T23:33:32.315 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.867986+0000", 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6980000000000003e-06 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875699+0000", 2024-04-15T23:33:32.316 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.007712338 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875793+0000", 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.4751000000000001e-05 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.317 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876259+0000", 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000465308 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882368+0000", 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0061087540000000001 2024-04-15T23:33:32.318 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882394+0000", 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.6727999999999999e-05 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.319 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882441+0000", 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.6851000000000003e-05 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.882483+0000", 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1690000000000002e-05 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.320 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:29 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.344808441, 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.01341348, 2024-04-15T23:33:32.321 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.322 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868003+0000", 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868004+0000", 2024-04-15T23:33:32.323 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.9299999999999997e-07 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868027+0000", 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.2656000000000001e-05 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.324 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868035+0000", 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.5599999999999994e-06 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868046+0000", 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1034e-05 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.325 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872403+0000", 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0043570579999999996 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.872815+0000", 2024-04-15T23:33:32.326 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00041148699999999999 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.873117+0000", 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030230200000000001 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.327 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878123+0000", 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0050062400000000003 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881317+0000", 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0031941769999999999 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.328 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881374+0000", 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.6509999999999999e-05 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881417+0000", 2024-04-15T23:33:32.329 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2762999999999997e-05 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:32.330 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34475098, 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.015704378000000001, 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:32.331 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868061+0000", 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.332 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868062+0000", 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 9.0999999999999997e-07 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868068+0000", 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.3790000000000003e-06 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.333 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868075+0000", 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.0489999999999998e-06 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.868080+0000", 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.3900000000000001e-06 2024-04-15T23:33:32.334 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.875983+0000", 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0079024009999999999 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.335 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876108+0000", 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00012492100000000001 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876412+0000", 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00030444000000000001 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.336 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883200+0000", 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0067881909999999998 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883674+0000", 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000473389 2024-04-15T23:33:32.337 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883722+0000", 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.8362000000000002e-05 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.338 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883765+0000", 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.2945999999999998e-05 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:32.339 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.34311532, 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.014324079999999999, 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:32.340 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869696+0000", 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.341 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869697+0000", 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0559999999999999e-06 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869731+0000", 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.3995999999999998e-05 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.342 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869876+0000", 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00014494599999999999 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.869888+0000", 2024-04-15T23:33:32.343 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.1705000000000001e-05 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878242+0000", 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0083535940000000006 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.344 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878358+0000", 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00011637999999999999 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 0", 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.878485+0000", 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000126475 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.345 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883245+0000", 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0047606469999999998 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883926+0000", 2024-04-15T23:33:32.346 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00068061599999999999 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883971+0000", 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4829000000000001e-05 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.347 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884020+0000", 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.9836000000000002e-05 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:27 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.348 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.342223788, 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013102340000000001, 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.349 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870588+0000", 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.350 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870589+0000", 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2589999999999999e-06 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870595+0000", 2024-04-15T23:33:32.351 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2570000000000004e-06 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870608+0000", 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.2478e-05 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.352 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870616+0000", 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.2090000000000005e-06 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876158+0000", 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055418109999999998 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.353 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876265+0000", 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0001066 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "waiting for subops from 2", 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.876442+0000", 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.00017704799999999999 2024-04-15T23:33:32.354 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "sub_op_commit_rec", 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.881987+0000", 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0055453489999999998 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883580+0000", 2024-04-15T23:33:32.355 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.001593328 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883649+0000", 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.8996000000000001e-05 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.356 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.883690+0000", 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.1004999999999998e-05 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e14)", 2024-04-15T23:33:32.357 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 121.342134324, 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.013484197999999999, 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "started", 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.358 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870677+0000", 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.359 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870678+0000", 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.2500000000000005e-07 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.360 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870680+0000", 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 2.424e-06 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870696+0000", 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.5095e-05 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.361 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.870703+0000", 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8690000000000004e-06 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879475+0000", 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.0087719549999999997 2024-04-15T23:33:32.362 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.879601+0000", 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000125174 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.363 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:31:30.884162+0000", 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.004561056 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.364 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2671 4.1e 4:7a2ea0db:::10000000c90.00000000:head [write 0~29] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.935193814000002, 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012287747, 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:32.365 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2671 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:32.366 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277618+0000", 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.367 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277619+0000", 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.2699999999999999e-07 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277622+0000", 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.7139999999999999e-06 2024-04-15T23:33:32.368 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277632+0000", 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0037999999999999e-05 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.369 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277637+0000", 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.7419999999999997e-06 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277705+0000", 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 6.7884000000000003e-05 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.370 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.277823+0000", 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.000118165 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289830+0000", 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.012006756 2024-04-15T23:33:32.371 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289865+0000", 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.4780999999999998e-05 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.372 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289906+0000", 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0939999999999998e-05 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: "description": "osd_op(client.4525.0:2672 4.3a 4:5e213337:::10000000c91.00000000:head [write 0~502] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-15T23:33:32.373 INFO:teuthology.orchestra.run.smithi115.stdout: "initiated_at": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "age": 25.934458463999999, 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011565466999999999, 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "continuous": false, 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "type_data": { 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "client_info": { 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "client": "client.4525", 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "client_addr": "192.168.0.1:0/1735269682", 2024-04-15T23:33:32.374 INFO:teuthology.orchestra.run.smithi115.stdout: "tid": 2672 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: "events": [ 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "initiated", 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "header_read", 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278353+0000", 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "throttled", 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278354+0000", 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 7.8599999999999997e-07 2024-04-15T23:33:32.376 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "all_read", 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278358+0000", 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.0629999999999999e-06 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "dispatched", 2024-04-15T23:33:32.377 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278369+0000", 2024-04-15T23:33:32.378 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 1.0525e-05 2024-04-15T23:33:32.378 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.378 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.378 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "queued_for_pg", 2024-04-15T23:33:32.381 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278374+0000", 2024-04-15T23:33:32.382 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 5.0200000000000002e-06 2024-04-15T23:33:32.382 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.382 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "reached_pg", 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278418+0000", 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4131000000000001e-05 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "started", 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.278498+0000", 2024-04-15T23:33:32.383 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 8.0284999999999994e-05 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "op_commit", 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289841+0000", 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 0.011343404 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "commit_sent", 2024-04-15T23:33:32.384 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289874+0000", 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 3.2441000000000003e-05 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: { 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: "event": "done", 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: "time": "2024-04-15T23:33:06.289919+0000", 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: "duration": 4.4811999999999997e-05 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.385 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.386 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-04-15T23:33:32.386 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-15T23:33:32.386 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:33:32.437 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:33:34.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-15T23:33:35.435 INFO:teuthology.orchestra.run.smithi102.stderr:noscrub is unset 2024-04-15T23:33:35.454 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-15T23:33:36.447 INFO:teuthology.orchestra.run.smithi102.stderr:nodeep-scrub is unset 2024-04-15T23:33:37.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-04-15T23:33:43.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-04-15T23:33:48.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-04-15T23:33:54.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-04-15T23:34:00.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~106s 2024-04-15T23:34:06.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-04-15T23:34:12.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-04-15T23:34:17.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-04-15T23:34:23.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-04-15T23:34:29.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2024-04-15T23:34:35.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-04-15T23:34:41.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2024-04-15T23:34:46.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~152s 2024-04-15T23:34:52.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~158s 2024-04-15T23:34:58.078 DEBUG:teuthology.orchestra.console.smithi195:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 80 81 GUID: 00000000 0000 0000 0000 0CC47AD936F0 DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.1 : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.195 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:80:81)... Configuring (net0 0c:c4:7a:88:80:81).... Configuring (net0 0c:c4:7a:88:80:81)..... Configuring (net0 0c:c4:7a:88:80:81)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-438.el9.x86_64) 9  CentOS Stream (5.14.0-361.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9              CentOS Stream (5.14.0-361.el9.x86_64) 9  The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-438.el9.x86_64) 9   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       Probing EDD (ed [ 0.000000] Linux version 5.14.0-438.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Fri Apr 12 13:55:21 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.695 MHz processor [ 0.000411] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000415] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000417] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000744] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.006514] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006523] Using GB pages for direct mapping [ 0.006636] RAMDISK: [mem 0x34356000-0x361a2fff] [ 0.006638] ACPI: Early table checksum verification disabled [ 0.006641] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006644] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006649] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006653] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006656] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006658] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006660] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006662] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006665] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006667] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006669] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006672] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006674] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006676] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006678] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006681] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006683] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006685] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006688] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006690] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006692] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006695] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006696] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006697] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006698] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006699] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006699] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006700] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006701] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006701] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006702] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006702] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006703] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006704] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006704] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006705] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006705] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006706] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006706] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006707] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006708] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006708] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006754] No NUMA configuration found [ 0.006755] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006763] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006958] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006994] Zone ranges: [ 0.006994] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006996] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006997] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006998] Device empty [ 0.006999] Movable zone start for each node [ 0.007001] Early memory node ranges [ 0.007001] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007003] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.007004] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007007] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007012] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007052] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.012069] On node 0, zone Normal: 29010 pages in unavailable ranges [ 0.012179] ACPI: PM-Timer IO Port: 0x408 [ 0.012187] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012188] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012189] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012190] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012190] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012191] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012191] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012192] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012201] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012205] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012206] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012208] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012211] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012212] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012216] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012217] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012227] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012228] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012229] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012230] PM: hibernation: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.012231] PM: hibernation: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.012231] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.012232] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.012232] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012233] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012233] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012234] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012235] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012236] Booting paravirtualized kernel on bare hardware [ 0.012238] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016554] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016774] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016799] Fallback order for Node 0: 0 [ 0.016801] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.016802] Policy zone: Normal [ 0.016803] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016861] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64", will be passed to user space. [ 0.016877] random: crng init done [ 0.019063] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020205] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020455] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020464] software IO TLB: area num 8. [ 0.048679] Memory: 1752192K/33437920K available (16384K kernel code, 5629K rwdata, 11796K rodata, 3932K init, 5900K bss, 987084K reserved, 0K cma-reserved) [ 0.048782] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048790] Kernel/User page tables isolation: enabled [ 0.048813] ftrace: allocating 47003 entries in 184 pages [ 0.067106] ftrace: allocated 184 pages with 4 groups [ 0.067617] Dynamic Preempt: voluntary [ 0.067647] rcu: Preemptible hierarchical RCU implementation. [ 0.067647] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067648] Trampoline variant of Tasks RCU enabled. [ 0.067649] Rude variant of Tasks RCU enabled. [ 0.067649] Tracing variant of Tasks RCU enabled. [ 0.067649] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067650] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070909] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.071072] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.071180] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076392] Console: colour VGA+ 80x25 [ 1.097928] printk: console [ttyS1] enabled [ 1.102118] ACPI: Core revision 20230331 [ 1.106211] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.115341] APIC: Switch to symmetric I/O mode setup [ 1.120309] DMAR: Host address width 46 [ 1.124145] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.129460] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.137456] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.143723] DMAR: ATSR flags: 0x0 [ 1.147043] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.153309] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.159663] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.166016] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.171417] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.171418] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.186438] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.191744] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.197967] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.208348] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272312c564, max_idle_ns: 440795365938 ns [ 1.218860] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.39 BogoMIPS (lpj=3499695) [ 1.219877] CPU0: Thermal monitoring enabled (TM1) [ 1.220914] process: using mwait in idle threads [ 1.221860] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.222859] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.223860] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.224859] Spectre V2 : Mitigation: Retpolines [ 1.225859] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.226859] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.227859] Speculative Store Bypass: Vulnerable [ 1.228865] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229859] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230859] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.231862] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.232859] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.233859] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.234859] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.235859] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.248371] Freeing SMP alternatives memory: 36K [ 1.248859] pid_max: default: 32768 minimum: 301 [ 1.249878] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.250863] Yama: becoming mindful. [ 1.251862] SELinux: Initializing. [ 1.252875] LSM support for eBPF active [ 1.254911] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.255897] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.359800] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.360955] cblist_init_generic: Setting adjustable number of callback queues. [ 1.361859] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362870] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.363868] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.364868] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.365859] ... version: 3 [ 1.366859] ... bit width: 48 [ 1.367859] ... generic registers: 4 [ 1.368859] ... value mask: 0000ffffffffffff [ 1.369859] ... max period: 00007fffffffffff [ 1.370859] ... fixed-purpose events: 3 [ 1.371859] ... event mask: 000000070000000f [ 1.372942] signal: max sigframe size: 1776 [ 1.373870] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.374884] rcu: Hierarchical SRCU implementation. [ 1.374884] rcu: Max phase no-delay instances is 400. [ 1.374892] printk: console [ttyS1] printing thread started [ 1.379459] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.379526] smp: Bringing up secondary CPUs ... [ 1.379593] smpboot: x86: Booting SMP configuration: [ 1.379594] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.386118] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.386118] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.386118] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.386118] smp: Brought up 1 node, 8 CPUs [ 1.386118] smpboot: Max logical packages: 1 [ 1.386118] smpboot: Total of 8 processors activated (55995.12 BogoMIPS) [ 1.436111] node 0 deferred pages initialised in 41ms [ 1.438158] devtmpfs: initialized [ 1.438158] x86/mm: Memory block size: 128MB [ 1.440005] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.440005] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.440005] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.440045] pinctrl core: initialized pinctrl subsystem [ 1.457869] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.457957] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.457968] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.457976] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.457984] audit: initializing netlink subsys (disabled) [ 1.457988] audit: type=2000 audit(1713224068.259:1): state=initialized audit_enabled=0 res=1 [ 1.457988] thermal_sys: Registered thermal governor 'fair_share' [ 1.457988] thermal_sys: Registered thermal governor 'step_wise' [ 1.457988] thermal_sys: Registered thermal governor 'user_space' [ 1.467861] cpuidle: using governor menu [ 1.474886] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.474887] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.474940] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.474943] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.474951] PCI: Using configuration type 1 for base access [ 1.492888] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.492891] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.492891] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.492891] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.492891] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.500895] cryptd: max_cpu_qlen set to 1000 [ 1.514052] ACPI: Added _OSI(Module Device) [ 1.514053] ACPI: Added _OSI(Processor Device) [ 1.514054] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.514055] ACPI: Added _OSI(Processor Aggregator Device) [ 1.514056] ACPI: Added _OSI(Linux-Dell-Video) [ 1.514057] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.514057] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.537839] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.539962] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.542950] ACPI: Dynamic OEM Table Load: [ 1.555725] ACPI: _OSC evaluated successfully for all CPUs [ 1.555987] ACPI: Interpreter enabled [ 1.555996] ACPI: PM: (supports S0 S4 S5) [ 1.555997] ACPI: Using IOAPIC for interrupt routing [ 1.557466] HEST: Enabling Firmware First mode for corrected errors. [ 1.597343] HEST: Table parsing has been initialized. [ 1.597458] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.597461] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.597461] PCI: Using E820 reservations for host bridge windows [ 1.597902] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.619053] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.619057] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.620181] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.620718] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.620719] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.620746] PCI host bridge to bus 0000:ff [ 1.620747] pci_bus 0000:ff: root bus resource [bus ff] [ 1.620758] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.620802] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.620833] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.620864] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.620895] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.620924] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.620952] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.620981] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.621011] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.621038] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.621067] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.621096] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.621124] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.621153] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.621183] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.621212] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.621240] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.621268] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.621297] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.621317] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.621352] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621411] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621469] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621527] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621585] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621643] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621700] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.621746] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.621793] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621838] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621880] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621921] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621962] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.621992] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.622022] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.62] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.622084] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622125] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622165] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622206] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622249] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.622283] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.622313] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.622347] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.622380] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.622410] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.622440] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.622470] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.622503] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 convenional PCI endpoint [ 1.622531] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.622561] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.622591] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.622614] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.622645] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.622675] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.624920] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.624923] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.625055] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.625297] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.625297] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.625705] PCI host bridge to bus 0000:00 [ 1.625706] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.625708] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.625709] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.625710] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.625711] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.625711] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.625712] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.625731] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.625833] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.625844] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.625882] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.625971] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.625982] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.625985] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.626018] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.626104] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.626115] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.626117] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.626119] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.626123] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.626152] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.626232] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626240] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.626315] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626322] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.626395] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626402] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.626474] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626481] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.626552] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626560] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.626632] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626639] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.626711] pci 0000:00:04.6: [80860 PCIe Root Comp6718] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.626790] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626797] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.626871] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626934] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627015] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627071] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.627076] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.627153] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.627390] pci 0000:00:11.4: [8086:601 conventionalpci 0000:00:11.41.627421] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.627433] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.627444] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.627455] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.627466] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.627525] pci 0000:00:11.4: PME# supported from D3hot [ 1.627603] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.627626] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.627713] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.627799] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.627823] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.627913] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.627977] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.628001] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.628088] pc from D0 D3hot D3cold [ 1.628171] pci 0000:00:1a.0: [8086:8d2d] type 00 clasconventional PCI endpoint [ 1.628192] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.628306] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.628388] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.628425] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.628515] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.628612] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.628651] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.628656] pci 0000:00:1c.2: bridge window [io 0xd000-0xd 1.628660] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.628748] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.628845] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.628886] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.628892] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.628895] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.628983] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.629084] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.629104] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.629219] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.629300] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.629501] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.629519] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.629529] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.629540] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.629550] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.629560] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.629571] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.629624] pci 0000:00:1f.2: PME# supported from D3hot [ 1.629684] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.629707] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.629736] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.629899] acpiphp: Slot [1] registered [ 1.629910] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.630011] pci 0000:02:00.0: [8086:2700] type 00 class 0x010802 PCIe Endpoint [ 1.630020] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.630036] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.630040] pci 0000:02:00.0: enabling Extended Tags [ 1.630144] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.630250] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630260] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.630264] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.630274] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.630279] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.630314] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.630330] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630331] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.630340] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630341] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.630489] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630499] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.630503] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.630513] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.630517] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.630553] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.630566] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630567] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.630575] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630576] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.630711] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.630756] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.630849] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.630921] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.630934] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.630940] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.630993] pci 0000:05:00.0: enabling Extended Tags [ 1.631114] pci 0000:05:00.0: supports D1 D2 [ 1.631114] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.631248] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.631337] pci_bus 0000:06: extended config space not accessible [ 1.631370] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.631406] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.631426] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.631446] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.631544] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.631614] pci 0000:06:00.0: supports D1 D2 [ 1.631615] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.631766] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.631913] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.631946] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.631982] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.632001] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.632228] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.632291] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632292] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.632325] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632326] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.632658] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.632692] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.632728] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.632746] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.632962] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.633020] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633021] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.633054] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633055] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.633348] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.633360] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.634040] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.634071] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.634101] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.634130] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.634160] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.634160] ACPI: PCI: Interrupt link LNKE disabled [ 1.634190] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.634191] ACPI: PCI: Interrupt link LNKF disabled [ 1.634220] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.634220] ACPI: PCI: Interrupt link LNKG disabled [ 1.634250] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.634250] ACPI: PCI: Interrupt link LNKH disabled [ 1.634874] iommu: Default domain type: Translated [ 1.634874] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.634926] SCSI subsystem initialized [ 1.634941] ACPI: bus type USB registered [ 1.634954] usbcore: registered new interface driver usbfs [ 1.634959] usbcore: registered new interface driver hub [ 1.634964] usbcore: registered new device driver usb [ 1.634984] pps_core: LinuxPPS API ver. 1 registered [ 1.634984] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.634986] PTP clock support registered [ 1.634998] EDAC MC: Ver: 3.0.0 [ 1.634998] NetLabel: Initializing [ 1.634998] NetLabel: domain hash size = 128 [ 1.634998] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.634998] NetLabel: unlabeled traffic allowed by default [ 1.634998] PCI: Using ACPI for IRQ routing [ 1.645882] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.645882] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.645882] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.645883] vgaarb: loaded [ 1.645890] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.645894] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.649759] clocksource: Switched to clocksource tsc-early [ 1.660538] VFS: Disk quotas dquot_6.6.0 [ 1.660549] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.660597] pnp: PnP ACPI init [ 1.660923] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.660926] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.660927] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.660928] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.660929] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.660930] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.660931] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.660932] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.660933] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.660934] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.660935] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.660935] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.660936] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.661083] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.661084] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.661085] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.661086] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.661087] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.661761] pnp: PnP ACPI: found 5 devices [ 1.667154] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.667192] NET: Registered PF_INET protocol family [ 1.667365] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.669644] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.669675] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.669684] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.669931] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.670045] TCP: Hash tables configured (established 262144 bind 65536) [ 1.670163] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.670248] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.670306] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.670385] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.670390] NET: Registered PF_XDP protocol family [ 1.670410] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.670421] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.670423] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.670428] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.670430] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.670435] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670437] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670438] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670439] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670440] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670441] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670442] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670443] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670444] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670445] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670446] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670447] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670448] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670449] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670450] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670451] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670452] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.670453] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.670455] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.670456] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.670460] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.670472] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.670475] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.670483] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.670499] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.670501] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.670505] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.670514] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.670520] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.670526] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.670532] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.670538] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.670540] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.670545] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.670549] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.670555] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.670555] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.670556] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.670557] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.670558] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.670559] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.670560] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.670561] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.670561] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.670562] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.670563] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.670564] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.670565] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.670565] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.670566] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.670567] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.670568] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.670568] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.670725] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.686910] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15638 usecs [ 1.702904] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15603 usecs [ 1.702917] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.702951] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.702951] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.702958] ACPI: bus type thunderbolt registered [ 1.702965] Trying to unpack rootfs image as initramfs... [ 1.761114] Initialise system trusted keyrings [ 1.761123] Key type blacklist registered [ 1.761170] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.762515] zbud: loaded [ 1.843839] integrity: Platform Keyring initialized [ 1.843845] integrity: Machine keyring initialized [ 1.851763] NET: Registered PF_ALG protocol family [ 1.851767] xor: automatically using best checksumming function avx [ 1.851769] Key type asymmetric registered [ 1.851770] Asymmetric key parser 'x509' registered [ 1.851770] Running certificate verification selftests [ 1.853120] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.854864] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.854895] io scheduler mq-deadline registered [ 1.854896] io scheduler kyber registered [ 1.854932] io scheduler bfq registered [ 1.876930] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.877260] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.877420] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.877561] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.877691] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.877844] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.878014] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.878176] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.878250] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.893696] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.893718] ACPI: button: Power Button [PWRB] [ 1.893740] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.893777] ACPI: button: Power Button [PWRF] [ 1.910502] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.910504] pstore: Registered erst as persistent store backend [ 1.910599] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.910684] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.918203] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.926802] Non-volatile memory driver v1.3 [ 1.934914] rdac: device handler registered [ 1.934945] hp_sw: device handler registered [ 1.934945] emc: device handler registered [ 1.934969] alua: device handler registered [ 1.935279] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.935316] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.935330] ehci-pci 0000:00:1d.0: debug port 2 [ 1.939258] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.945869] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.945960] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.945962] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.945963] usb usb1: Product: EHCI Host Controller [ 1.945964] usb usb1: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.945965] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.946093] hub 1-0:1.0: USB hub found [ 1.946101] hub 1-0:1.0: 2 ports detected [ 1.946289] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.946352] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.947445] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.947672] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.947675] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.947717] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 1.947721] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 1.947723] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.947736] ehci-pci 0000:00:1a.0: debug port 2 [ 1.947765] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.947767] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.947768] usb usb2: Product: xHCI Host Controller [ 1.947769] usb usb2: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.947770] usb usb2: SerialNumber: 0000:00:14.0 [ 1.947886] hub 2-0:1.0: USB hub found [ 1.947919] hub 2-0:1.0: 15 ports detected [ 1.951129] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.951131] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.951133] usb usb4: Product: xHCI Host Controller [ 1.951134] usb usb4: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.951135] usb usb4: SerialNumber: 0000:00:14.0 [ 1.951235] hub 4-0:1.0: USB hub found [ 1.951250] hub 4-0:1.0: 6 ports detected [ 1.951660] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.952946] usbcore: registered new interface driver usbserial_generic [ 1.952952] usbserial: USB Serial support registered for generic [ 1.952985] i8042: PNP: No PS/2 controller found. [ 1.953015] mousedev: PS/2 mouse device common for all mice [ 1.953088] rtc_cmos 00:00: RTC can wake from S4 [ 1.953377] rtc_cmos 00:00: registered as rtc0 [ 1.953421] rtc_cmos 00:00: setting system clock to 2024-04-15T23:34:30 UTC (1713224070) [ 1.953448] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.957890] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.957933] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.957935] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.957936] usb usb3: Product: EHCI Host Controller [ 1.957937] usb usb3: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.957937] usb usb3: SerialNumber: 0000:00:1a.0 [ 1.958011] hub 3-0:1.0: USB hub found [ 1.958014] hub 3-0:1.0: 2 ports detected [ 1.979183] intel_pstate: Intel P-state driver initializing [ 2.010358] Freeing initrd memory: 31028K [ 2.016046] hid: raw HID events driver (C) Jiri Kosina [ 2.016091] usbcore: registered new interface driver usbhid [ 2.016091] usbhid: USB HID core driver [ 2.016140] drop_monitor: Initializing network drop monitor service [ 2.024894] Initializing XFRM netlink socket [ 2.024975] NET: Registered PF_INET6 protocol family [ 2.029889] Segment Routing with IPv6 [ 2.029907] NET: Registered PF_PACKET protocol family [ 2.029927] mpls_gso: MPLS GSO support [ 2.051631] microcode: Current revision: 0x0b000010 [ 2.085771] resctrl: L3 allocation detected [ 2.085773] resctrl: L3 monitoring detected [ 2.085785] IPI shorthand broadcast: enabled [ 2.085790] AVX2 version of gcm_enc/dec engaged. [ 2.147732] AES CTR mode by8 optimization enabled [ 2.147770] sched_clock: Marking stable (1019100873, 1127758117)->(2485962753, -339103763) [ 2.156074] registered taskstats version 1 [ 2.172714] Loading compiled-in X.509 certificates [ 2.173220] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.173486] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.173744] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.173902] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.173912] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.174074] zswap: loaded using pool lzo/zbud [ 2.183893] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.189080] page_owner is disabled [ 2.189246] pstore: Using crash dump compression: deflate [ 2.189256] Key type big_key registered [ 2.198896] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.207884] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.314536] Key type encrypted registered [ 2.314548] ima: No TPM chip found, activating TPM-bypass! [ 2.314550] Loading compiled-in module X.509 certificates [ 2.314839] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.314842] ima: Allocated hash algorithm: sha256 [ 2.314850] ima: No architecture policies found [ 2.314856] evm: Initialising EVM extended attributes: [ 2.314856] evm: security.selinux [ 2.314857] evm: security.SMACK64 (disabled) [ 2.314858] evm: security.SMACK64EXEC (disabled) [ 2.314862] evm: security.SMACK64TRANSMUTE (disabled) [ 2.314862] evm: security.SMACK64MMAP (disabled) [ 2.314863] evm: security.apparmor (disabled) [ 2.314864] evm: security.ima [ 2.314864] evm: security.capability [ 2.314865] evm: HMAC attrs: 0x1 [ 2.320212] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.320214] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.320496] hub 1-1:1.0: USB hub found [ 2.320585] hub 1-1:1.0: 8 ports detected [ 2.325061] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.325064] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.325601] hub 2-12:1.0: USB hub found [ 2.325680] hub 2-12:1.0: 4 ports detected [ 2.341227] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.341229] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.341499] hub 3-1:1.0: USB hub found [ 2.341587] hub 3-1:1.0: 6 ports detected [ 2.617885] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.722221] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.722223] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.727263] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.765888] tsc: Refined TSC clocksource calibration: 3499.994 MHz [ 2.765891] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734b4358f, max_idle_ns: 440795367814 ns [ 2.769153] clocksource: Switched to clocksource tsc [ 2.779000] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.781687] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.781758] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.174985] Freeing unused decrypted memory: 2028K [ 5.175436] Freeing unused kernel image (initmem) memory: 3932K [ 5.186910] Write protecting the kernel read-only data: 28672k [ 5.187360] Freeing unused kernel image (rodata/data gap) memory: 492K [ 5.226373] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.226374] x86/mm: Checking user space page tables [ 5.261111] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.261122] Run /init as init process [ 5.274817] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.274928] systemd[1]: Detected architecture x86-64. [ 5.274930] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-44.git20230822.el9 (Initramfs)! [ 5.326081] systemd[1]: Hostname set to . [ OK [[ 5.385457] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.385567] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.406983] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.421035] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.433008] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.443945] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.456162] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.471086] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.485014] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.497203] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.511142] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.524985] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.543576] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.558950] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.571599] systemd[1]: Starting Load Kernel Modules... g Load Kernel Modules... Startin[ 5.584472] systemd[1]: Starting Create System Users... g Create System Users... [ 5.592960] fuse: init (API version 7.36) Startin[ 5.599108] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.611614] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 5.988675] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Starte[ 6.019871] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.019873] igb: Copyright (c) 2007-2014 Intel Corporation. d Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target [0;1;39[ 6.041700] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.041702] ixgbe: Copyright (c) 1999-2016 Intel Corporation. mPath Units. [ OK ] Reached target Basic System. [ 6.064461] nvme nvme0: pci function 0000:02:00.0 [ 6.067416] nvme nvme0: 8/0/0 default/read/poll queues [ 6.079991] igb 0000:07:00.0: added PHC on eth0 [ 6.080010] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.080012] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:f0 [ 6.080095] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.080096] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.093698] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.093702] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.095126] ACPI: bus type drm_connector registered [ 6.105065] scsi host0: ahci [ 6.105194] scsi host1: ahci [ 6.105281] scsi host2: ahci [ 6.105368] scsi host3: ahci [ 6.105407] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 62 lpm-pol 0 [ 6.105409] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 62 lpm-pol 0 [ 6.105412] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 62 lpm-pol 0 [ 6.105415] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 62 lpm-pol 0 [ 6.105700] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.105703] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.120243] scsi host4: ahci [ 6.120340] scsi host5: ahci [ 6.120429] scsi host6: ahci [ 6.120516] scsi host7: ahci [ 6.120601] scsi host8: ahci [ 6.120689] scsi host9: ahci [ 6.120727] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.120729] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.120732] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.120734] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.120737] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.120739] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.137359] igb 0000:07:00.1: added PHC on eth1 [ 6.137389] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.137390] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:f1 [ 6.137474] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.137475] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.138584] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.145979] igb 0000:07:00 6.161185] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.169933] Console: switching to colour dummy device 80x25 [ 6.170068] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.170069] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.170079] ast 0000:06:00.0: [drm] Using analog VGA [ 6.170084] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.170230] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.179572] fbcon: astdrmfb (fb0) is primary device [ 6.204169] Console: switching to colour frame buffer device 128x48 [ 6.222915] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.411028] ata2: SATA link down (SStatus 0 SControl 300) [ 6.411071] ata3: SATA link down (SStatus 0 SControl 300) [ 6.411238] ata4: SATA link down (SStatus 0 SControl 300) [ 6.411461] ata1: SATA link down (SStatus 0 SControl 300) [ 6.426983] ata6: SATA link down (SStatus 0 SControl 300) [ 6.427011] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.427030] ata9: SATA link down (SStatus 0 SControl 300) [ 6.427071] ata8: SATA link down (SStatus 0 SControl 300) [ 6.427125] ata10: SATA link down (SStatus 0 SControl 300) [ 6.427148] ata7: SATA link down (SStatus 0 SControl 300] ata5.00: ATA-9, SN06, max UDMA17] ata5.00: NCQ Send/Recv Log not supported [ 6.428118] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.429524] ata5.00: NCQ Send/Recv Log not supported [ 6.429526] ata5.00: configured for UDMA/133 [ 6.429619] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.502755] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.566187] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.566203] sd 4:0:0:0: [sda] Write Protect is off [ 6.566226] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.566248] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.575296] sda: sda1 [ 6.575371] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.195296] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.195584] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.195666] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.195667] ixgbe 0000:03:00.0: 0c:c4:7a:88:80:80 [ 7.198715] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.356046] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.356333] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.356414] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.356416] ixgbe 0000:03:00.1: 0c:c4:7a:88:80:81 [ 7.359385] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.367618] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.400384] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…7844-4e73-a652-6bb884dfb0a5... [ OK ] Finished File System Check…0-7844-4e73-a652-6bb884dfb0a5. Mounting /sysroot... [ 7.633259] EXT4-fs (sda1): mounted filesystem 0b261d40-7844-4e73-a652-6bb884dfb0a5 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.979139] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). [ 8.476818] SELinux: policy capability network_peer_controls=1 [ 8.476822] SELinux: policy capability open_perms=1 [ 8.476822] SELinux: policy capability extended_socket_class=1 [ 8.476823] SELinux: policy capability always_check_network=0 [ 8.476823] SELinux: policy capability cgroup_seclabel=1 [ 8.476823] SELinux: policy capability nnp_nosuid_transition=1 [ 8.476824] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.520330] audit: type=1403 audit(1713224077.065:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.522639] systemd[1]: Successfully loaded SELinux policy in 115.340ms. [ 8.602498] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.663ms. [ 8.616444] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.616548] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ OK [[ 9.718362] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.718456] systemd[1]: Stopped Switch Root. [ 9.718853] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.719202] systemd[1]: Created slice Slice /system/getty. [ 9.740715] systemd[1]: Created slice Slice /system/modprobe. 0m] Stopped Switch Root[ 9.752096] systemd[1]: Created slice Slice /system/serial-getty. [ 9.752378] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.752620] systemd[1]: Created slice User and Session Slice. [ 9.752651] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.752744] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.753117] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. . [[ 9.804171] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.804198] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.804214] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.804229] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.804243] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.804270] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.804288] systemd[1]: Reached target Local Encrypted Volumes. [ 9.804313] systemd[1]: Stopped target Switch Root. [ 9.804332] systemd[1]: Stopped target Initrd File Systems. [ 9.804346] systemd[1]: Stopped target Initrd Root File System. [ 9.804361] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.804396] systemd[1]: Reached target Path Units. [ 9.804438] systemd[1]: Reached target Slice Units. [ 9.804458] systemd[1]: Reached target Swaps. [ 9.804474] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.804816] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.805798] systemd[1]: Listening on LVM2 poll daemon socket. OK ] Created slice Slice /system/getty. [ OK ] Created slice Slice /system/modprobe[ 9.940357] systemd[1]: Listening on RPCbind Server Activation Socket. [0m. [ [ 9.940414] systemd[1]: Reached target RPC Port Mapper. [ 9.951625] systemd[1]: Listening on Process Core Dump Socket. OK ] Creat[ 9.960547] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.961330] systemd[1]: Listening on udev Control Socket. ed slice [0;1;3[ 9.973994] systemd[1]: Listening on udev Kernel Socket. 9mSlice /system/serial-getty. [ OK ] Created slice S[ 9.986026] systemd[1]: Mounting Huge Pages File System... [ 9.986925] systemd[1]: Mounting POSIX Message Queue File System... lice /system/sshd-keygen. [ 9.999972] systemd[1]: Mounting Kernel Debug File System... [ 10.000794] systemd[1]: Mounting Kernel Trace File System... [ 10.000933] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [ 10.024147] systemd[1]: Starting Create List of Static Device Nodes... [ OK [[ 10.033794] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 10.034693] systemd[1]: Starting Load Kernel Module configfs... 0m] Created slice User [ 10.051373] systemd[1]: Starting Load Kernel Module drm... [ 10.052181] systemd[1]: Starting Load Kernel Module fuse... and Session Slice. [[0;32[ 10.065848] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 10.065944] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.065996] systemd[1]: Stopped Plymouth switch root service. m OK ] Sta[ 10.083075] systemd[1]: Stopped Journal Service. rted Forward Password R[ 10.095869] systemd[1]: Starting Journal Service... [ 10.097808] systemd[1]: Starting Load Kernel Modules... …uests to Wall Directory Watch[ 10.108220] systemd[1]: Starting Generate network units from Kernel command line... . [[ 10.109040] systemd[1]: Starting Remount Root and Kernel File Systems... OK ] Set [ 10.126001] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.126848] systemd[1]: Starting Coldplug All udev Devices... [ 10.128501] systemd[1]: Mounted Huge Pages File System. up automount [0[ 10.142628] systemd[1]: Mounted POSIX Message Queue File System. [ 10.147842] systemd[1]: Mounted Kernel Debug File System. [ 10.148043] systemd[1]: Mounted Kernel Trace File System. ;1;39mArbitrary\xe2[ 10.155498] EXT4-fs (sda1): re-mounted 0b261d40-7844-4e73-a652-6bb884dfb0a5 r/w. Quota mode: none. [ 10.161455] systemd[1]: Finished Create List of Static Device Nodes. \x80\xa6s File System Automount Point[ 10.182884] systemd[1]: modprobe@drm.service: Deactivated successfully. [ 10.182991] systemd[1]: Finished Load Kernel Module drm. [ 10.183203] systemd[1]: modprobe@fuse.service: Deactivated successfully. [ 10.183291] systemd[1]: Finished Load Kernel Module fuse. [0m. [ [ 10.183567] systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. [ 10.183843] systemd[1]: Finished Generate network units from Kernel command line. [ 10.184079] systemd[1]: Finished Remount Root and Kernel File Systems. [ 10.192123] systemd[1]: Reached target Preparation for Network. [ 10.235070] systemd[1]: Mounting FUSE Control File System... OK ] Reach[ 10.244473] systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes). ed target [0;1;[ 10.251818] systemd[1]: Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc). [ 10.252802] systemd[1]: Starting Load/Save Random Seed... 39mceph target\xe2\x80[ 10.256304] systemd[1]: Create System Users was skipped because no trigger condition checks were met. [ 10.257153] systemd[1]: Starting Create Static Device Nodes in /dev... \xa6on@.service ins[ 10.275576] systemd[1]: Started Journal Service. tances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll [ 10.406427] systemd-journald[572]: Received client request to flush runtime journal. daemon socket. [ OK ] Listeni[ 10.416894] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. ng on R[ 10.416911] device-mapper: uevent: version 1.0.3 [ 10.416995] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com PCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Modules. [ OK ] Mounted FUSE Control File System. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Apply Kernel Variables... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs[ 10.817128] IPMI message handler: version 39.2 . [ OK ] Finished Lo[ 10.825114] ipmi device interface ad Kernel Module fuse. [ OK ] Finished [0;1;[ 10.833869] ipmi_si: IPMI System Interface driver 39mAutomatic Boo[ 10.833883] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.833885] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.833887] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.833925] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.833993] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.834300] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI t Loader Update[ 10.834302] ipmi_si: Adding ACPI-specified kcs state machine [ 10.834351] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [0m. [ OK ] Finis[ 10.902271] power_meter ACPI000D:00: Found ACPI power meter. hed Tel[ 10.902422] power_meter ACPI000D:00: Ignoring unsafe software power cap! l Plymouth To Wr[ 10.902429] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). ite Out Runtime [ 10.916586] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. Data. [ 10.942126] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.956524] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.965087] igb 0000:07:00.0: DCA enabled [ 10.965101] igb 0000:07:00.1: DCA enabled [ 10.974128] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.981021] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.991875] ipmi_ssif: IPMI SSIF Interface driver [ 11.004468] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.037233] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.037900] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 11.037902] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 11.075001] iTCO_vendor_support: vendor-support=0 [ 11.081717] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.082400] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.082402] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.082403] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.085000] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting RPC Bind... Mounting RPC Pipe File System... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started RPC Bind[0[ 11.378149] RPC: Registered named UNIX socket transport module. m. [ 11.378151] RPC: Registered udp transport module. [ OK ] Mounted RPC Pipe Fi[ 11.378152] RPC: Registered tcp transport module. le System. [ 11.378152] RPC: Registered tcp-with-tls transport module. [ 11.378153] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Reached target rpc_pipefs.target. [ OK [[ 11.637645] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled 0m] Started Security Au[ 11.647749] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. diting Service[[ 11.647780] XFS (dm-4): Mounting V4 Filesystem 55c03363-80f4-45b9-9199-da1d41cb24f0 [ 11.650627] XFS (dm-4): Ending clean mount 0m. [ 11.650677] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted /var/lib/ceph. [ 11.698955] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.698956] EDAC sbridge: Ver: 1.1.2 [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK [[ 11.749094] intel_rapl_common: Found RAPL domain package [ 11.749101] intel_rapl_common: Found RAPL domain dram 0m] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Authorization Manager... Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [* ] (1 of 2) A start job is running for…horization Manager (5s / no limit) M [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Started Authorization Manager. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.740820] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.897158] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... [ 16.122086] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ 16.318002] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.318116] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. + myips=172.21.15.195 + attempts=1 + sleep 1 + '[' 172.21.15.195 '!=' '' ']' + set -e + '[' -n 172.21.15.195 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.195 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.195 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi195.front.sepia.ceph.com + '[' -n smithi195.front.sepia.ceph.com ']' + hostname smithi195.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi195 + echo smithi195 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.195 smithi195.front.sepia.ceph.com smithi195/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ 26.159824] block sda: the capability attribute has been deprecated. CentOS Stream 9 Kernel 5.14.0-438.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-15T23:34:58.080 DEBUG:teuthology.orchestra.console.smithi195:expect after: smithi195 login: 2024-04-15T23:34:58.132 DEBUG:teuthology.orchestra.console.smithi195:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 80 81 GUID: 00000000 0000 0000 0000 0CC47AD936F0 DHCP./                    DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.|  21.15.1 : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.195 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:80:81)... Configuring (net0 0c:c4:7a:88:80:81).... Configuring (net0 0c:c4:7a:88:80:81)..... Configuring (net0 0c:c4:7a:88:80:81)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-438.el9.x86_64) 9  CentOS Stream (5.14.0-361.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9              CentOS Stream (5.14.0-361.el9.x86_64) 9  The selected entry will be started automatically in 5s.  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-438.el9.x86_64) 9   The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       Probing EDD (ed [ 0.000000] Linux version 5.14.0-438.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Fri Apr 12 13:55:21 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eadfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f60000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.695 MHz processor [ 0.000411] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000415] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000417] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000744] last_pfn = 0x78eae max_arch_pfn = 0x400000000 [ 0.006514] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006523] Using GB pages for direct mapping [ 0.006636] RAMDISK: [mem 0x34356000-0x361a2fff] [ 0.006638] ACPI: Early table checksum verification disabled [ 0.006641] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006644] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.006649] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006653] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006656] ACPI: FACS 0x0000000079D49F80 000040 [ 0.006658] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006660] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006662] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006665] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006667] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006669] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006672] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006674] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006676] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006678] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006681] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006683] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006685] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006688] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006690] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006692] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006695] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006696] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.006697] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.006698] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.006699] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.006699] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.006700] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.006701] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.006701] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.006702] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.006702] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.006703] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.006704] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.006704] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.006705] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.006705] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.006706] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.006706] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.006707] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.006708] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.006708] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.006754] No NUMA configuration found [ 0.006755] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006763] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006958] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006994] Zone ranges: [ 0.006994] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006996] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006997] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006998] Device empty [ 0.006999] Movable zone start for each node [ 0.007001] Early memory node ranges [ 0.007001] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.007003] node 0: [mem 0x0000000000100000-0x0000000078eadfff] [ 0.007004] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.007007] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.007012] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007052] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.012069] On node 0, zone Normal: 29010 pages in unavailable ranges [ 0.012179] ACPI: PM-Timer IO Port: 0x408 [ 0.012187] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.012188] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.012189] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.012190] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.012190] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.012191] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.012191] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.012192] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.012201] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.012205] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.012206] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.012208] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.012211] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.012212] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.012216] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.012217] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.012227] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.012228] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.012229] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.012230] PM: hibernation: Registered nosave memory: [mem 0x78eae000-0x78f5ffff] [ 0.012231] PM: hibernation: Registered nosave memory: [mem 0x78f60000-0x798adfff] [ 0.012231] PM: hibernation: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.012232] PM: hibernation: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.012232] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.012233] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.012233] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.012234] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012235] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012236] Booting paravirtualized kernel on bare hardware [ 0.012238] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016554] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016774] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016799] Fallback order for Node 0: 0 [ 0.016801] Built 1 zonelists, mobility grouping on. Total pages: 8228723 [ 0.016802] Policy zone: Normal [ 0.016803] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016861] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64", will be passed to user space. [ 0.016877] random: crng init done [ 0.019063] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.020205] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020455] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020464] software IO TLB: area num 8. [ 0.048679] Memory: 1752192K/33437920K available (16384K kernel code, 5629K rwdata, 11796K rodata, 3932K init, 5900K bss, 987084K reserved, 0K cma-reserved) [ 0.048782] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.048790] Kernel/User page tables isolation: enabled [ 0.048813] ftrace: allocating 47003 entries in 184 pages [ 0.067106] ftrace: allocated 184 pages with 4 groups [ 0.067617] Dynamic Preempt: voluntary [ 0.067647] rcu: Preemptible hierarchical RCU implementation. [ 0.067647] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.067648] Trampoline variant of Tasks RCU enabled. [ 0.067649] Rude variant of Tasks RCU enabled. [ 0.067649] Tracing variant of Tasks RCU enabled. [ 0.067649] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.067650] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.070909] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.071072] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.071180] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.076392] Console: colour VGA+ 80x25 [ 1.097928] printk: console [ttyS1] enabled [ 1.102118] ACPI: Core revision 20230331 [ 1.106211] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.115341] APIC: Switch to symmetric I/O mode setup [ 1.120309] DMAR: Host address width 46 [ 1.124145] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.129460] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.137456] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.143723] DMAR: ATSR flags: 0x0 [ 1.147043] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.153309] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.159663] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.166016] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.171417] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.171418] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.186438] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.191744] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.197967] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.208348] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3272312c564, max_idle_ns: 440795365938 ns [ 1.218860] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.39 BogoMIPS (lpj=3499695) [ 1.219877] CPU0: Thermal monitoring enabled (TM1) [ 1.220914] process: using mwait in idle threads [ 1.221860] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.222859] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.223860] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.224859] Spectre V2 : Mitigation: Retpolines [ 1.225859] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.226859] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.227859] Speculative Store Bypass: Vulnerable [ 1.228865] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229859] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230859] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.231862] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.232859] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.233859] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.234859] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.235859] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.248371] Freeing SMP alternatives memory: 36K [ 1.248859] pid_max: default: 32768 minimum: 301 [ 1.249878] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.250863] Yama: becoming mindful. [ 1.251862] SELinux: Initializing. [ 1.252875] LSM support for eBPF active [ 1.254911] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.255897] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.359800] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.360955] cblist_init_generic: Setting adjustable number of callback queues. [ 1.361859] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362870] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.363868] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.364868] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.365859] ... version: 3 [ 1.366859] ... bit width: 48 [ 1.367859] ... generic registers: 4 [ 1.368859] ... value mask: 0000ffffffffffff [ 1.369859] ... max period: 00007fffffffffff [ 1.370859] ... fixed-purpose events: 3 [ 1.371859] ... event mask: 000000070000000f [ 1.372942] signal: max sigframe size: 1776 [ 1.373870] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.374884] rcu: Hierarchical SRCU implementation. [ 1.374884] rcu: Max phase no-delay instances is 400. [ 1.374892] printk: console [ttyS1] printing thread started [ 1.379459] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.379526] smp: Bringing up secondary CPUs ... [ 1.379593] smpboot: x86: Booting SMP configuration: [ 1.379594] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.386118] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.386118] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.386118] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.386118] smp: Brought up 1 node, 8 CPUs [ 1.386118] smpboot: Max logical packages: 1 [ 1.386118] smpboot: Total of 8 processors activated (55995.12 BogoMIPS) [ 1.436111] node 0 deferred pages initialised in 41ms [ 1.438158] devtmpfs: initialized [ 1.438158] x86/mm: Memory block size: 128MB [ 1.440005] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.440005] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.440005] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.440045] pinctrl core: initialized pinctrl subsystem [ 1.457869] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.457957] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.457968] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.457976] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.457984] audit: initializing netlink subsys (disabled) [ 1.457988] audit: type=2000 audit(1713224068.259:1): state=initialized audit_enabled=0 res=1 [ 1.457988] thermal_sys: Registered thermal governor 'fair_share' [ 1.457988] thermal_sys: Registered thermal governor 'step_wise' [ 1.457988] thermal_sys: Registered thermal governor 'user_space' [ 1.467861] cpuidle: using governor menu [ 1.474886] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.474887] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.474940] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.474943] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.474951] PCI: Using configuration type 1 for base access [ 1.492888] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.492891] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.492891] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.492891] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.492891] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.500895] cryptd: max_cpu_qlen set to 1000 [ 1.514052] ACPI: Added _OSI(Module Device) [ 1.514053] ACPI: Added _OSI(Processor Device) [ 1.514054] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.514055] ACPI: Added _OSI(Processor Aggregator Device) [ 1.514056] ACPI: Added _OSI(Linux-Dell-Video) [ 1.514057] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.514057] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.537839] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.539962] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.542950] ACPI: Dynamic OEM Table Load: [ 1.555725] ACPI: _OSC evaluated successfully for all CPUs [ 1.555987] ACPI: Interpreter enabled [ 1.555996] ACPI: PM: (supports S0 S4 S5) [ 1.555997] ACPI: Using IOAPIC for interrupt routing [ 1.557466] HEST: Enabling Firmware First mode for corrected errors. [ 1.597343] HEST: Table parsing has been initialized. [ 1.597458] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.597461] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.597461] PCI: Using E820 reservations for host bridge windows [ 1.597902] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.619053] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.619057] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.620181] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.620718] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.620719] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.620746] PCI host bridge to bus 0000:ff [ 1.620747] pci_bus 0000:ff: root bus resource [bus ff] [ 1.620758] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.620802] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.620833] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.620864] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.620895] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.620924] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.620952] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.620981] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.621011] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.621038] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.621067] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.621096] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.621124] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.621153] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.621183] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.621212] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.621240] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.621268] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.621297] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.621317] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.621352] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621411] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621469] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621527] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621585] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621643] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621700] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.621746] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.621793] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621838] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621880] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621921] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.621962] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.621992] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.622022] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.62] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.622084] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622125] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622165] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622206] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.622249] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.622283] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.622313] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.622347] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.622380] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.622410] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.622440] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.622470] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.622503] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 convenional PCI endpoint [ 1.622531] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.622561] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.622591] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.622614] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.622645] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.622675] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.624920] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.624923] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.625055] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.625297] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.625297] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.625705] PCI host bridge to bus 0000:00 [ 1.625706] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.625708] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.625709] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.625710] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.625711] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.625711] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.625712] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.625731] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.625833] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.625844] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.625882] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.625971] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.625982] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.625985] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.626018] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.626104] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.626115] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.626117] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.626119] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.626123] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.626152] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.626232] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626240] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.626315] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626322] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.626395] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626402] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.626474] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626481] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.626552] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626560] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.626632] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626639] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.626711] pci 0000:00:04.6: [80860 PCIe Root Comp6718] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.626790] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626797] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.626871] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.626934] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627015] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.627071] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.627076] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.627153] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.627390] pci 0000:00:11.4: [8086:601 conventionalpci 0000:00:11.41.627421] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.627433] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.627444] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.627455] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.627466] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.627525] pci 0000:00:11.4: PME# supported from D3hot [ 1.627603] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.627626] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.627713] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.627799] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.627823] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.627913] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.627977] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.628001] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 64bit] [ 1.628088] pc from D0 D3hot D3cold [ 1.628171] pci 0000:00:1a.0: [8086:8d2d] type 00 clasconventional PCI endpoint [ 1.628192] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.628306] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.628388] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.628425] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.628515] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.628612] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.628651] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.628656] pci 0000:00:1c.2: bridge window [io 0xd000-0xd 1.628660] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.628748] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.628845] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.628886] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.628892] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.628895] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.628983] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.629084] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.629104] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.629219] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.629300] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.629501] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.629519] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.629529] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.629540] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.629550] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.629560] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.629571] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.629624] pci 0000:00:1f.2: PME# supported from D3hot [ 1.629684] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.629707] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.629736] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.629899] acpiphp: Slot [1] registered [ 1.629910] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.630011] pci 0000:02:00.0: [8086:2700] type 00 class 0x010802 PCIe Endpoint [ 1.630020] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.630036] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.630040] pci 0000:02:00.0: enabling Extended Tags [ 1.630144] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.630250] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630260] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.630264] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.630274] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.630279] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.630314] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.630330] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630331] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.630340] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630341] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.630489] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.630499] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.630503] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.630513] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.630517] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.630553] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.630566] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630567] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.630575] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.630576] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.630711] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.630756] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.630849] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.630921] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.630934] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.630940] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.630993] pci 0000:05:00.0: enabling Extended Tags [ 1.631114] pci 0000:05:00.0: supports D1 D2 [ 1.631114] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.631248] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.631337] pci_bus 0000:06: extended config space not accessible [ 1.631370] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.631406] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.631426] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.631446] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.631544] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.631614] pci 0000:06:00.0: supports D1 D2 [ 1.631615] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.631766] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.631913] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.631946] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.631982] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.632001] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.632228] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.632291] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632292] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.632325] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.632326] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.632658] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.632692] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.632728] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.632746] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.632962] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.633020] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633021] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.633054] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.633055] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.633348] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.633360] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.634040] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.634071] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.634101] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.634130] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.634160] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.634160] ACPI: PCI: Interrupt link LNKE disabled [ 1.634190] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.634191] ACPI: PCI: Interrupt link LNKF disabled [ 1.634220] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.634220] ACPI: PCI: Interrupt link LNKG disabled [ 1.634250] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.634250] ACPI: PCI: Interrupt link LNKH disabled [ 1.634874] iommu: Default domain type: Translated [ 1.634874] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.634926] SCSI subsystem initialized [ 1.634941] ACPI: bus type USB registered [ 1.634954] usbcore: registered new interface driver usbfs [ 1.634959] usbcore: registered new interface driver hub [ 1.634964] usbcore: registered new device driver usb [ 1.634984] pps_core: LinuxPPS API ver. 1 registered [ 1.634984] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.634986] PTP clock support registered [ 1.634998] EDAC MC: Ver: 3.0.0 [ 1.634998] NetLabel: Initializing [ 1.634998] NetLabel: domain hash size = 128 [ 1.634998] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.634998] NetLabel: unlabeled traffic allowed by default [ 1.634998] PCI: Using ACPI for IRQ routing [ 1.645882] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.645882] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.645882] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.645883] vgaarb: loaded [ 1.645890] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.645894] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.649759] clocksource: Switched to clocksource tsc-early [ 1.660538] VFS: Disk quotas dquot_6.6.0 [ 1.660549] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.660597] pnp: PnP ACPI init [ 1.660923] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.660926] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.660927] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.660928] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.660929] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.660930] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.660931] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.660932] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.660933] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.660934] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.660935] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.660935] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.660936] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.661083] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.661084] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.661085] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.661086] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.661087] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.661761] pnp: PnP ACPI: found 5 devices [ 1.667154] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.667192] NET: Registered PF_INET protocol family [ 1.667365] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.669644] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.669675] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.669684] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.669931] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.670045] TCP: Hash tables configured (established 262144 bind 65536) [ 1.670163] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.670248] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.670306] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.670385] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.670390] NET: Registered PF_XDP protocol family [ 1.670410] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.670421] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.670423] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.670428] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.670430] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.670435] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670437] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670438] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670439] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670440] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670441] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670442] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670443] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670444] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670445] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670446] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670447] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670448] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670449] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670450] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.670451] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.670452] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.670453] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.670455] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.670456] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.670460] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.670472] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.670475] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.670483] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.670499] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.670501] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.670505] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.670514] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.670520] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.670526] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.670532] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.670538] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.670540] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.670545] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.670549] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.670555] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.670555] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.670556] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.670557] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.670558] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.670559] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.670560] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.670561] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.670561] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.670562] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.670563] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.670564] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.670565] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.670565] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.670566] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.670567] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.670568] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.670568] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.670725] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.686910] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 15638 usecs [ 1.702904] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 15603 usecs [ 1.702917] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.702951] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.702951] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.702958] ACPI: bus type thunderbolt registered [ 1.702965] Trying to unpack rootfs image as initramfs... [ 1.761114] Initialise system trusted keyrings [ 1.761123] Key type blacklist registered [ 1.761170] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.762515] zbud: loaded [ 1.843839] integrity: Platform Keyring initialized [ 1.843845] integrity: Machine keyring initialized [ 1.851763] NET: Registered PF_ALG protocol family [ 1.851767] xor: automatically using best checksumming function avx [ 1.851769] Key type asymmetric registered [ 1.851770] Asymmetric key parser 'x509' registered [ 1.851770] Running certificate verification selftests [ 1.853120] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.854864] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.854895] io scheduler mq-deadline registered [ 1.854896] io scheduler kyber registered [ 1.854932] io scheduler bfq registered [ 1.876930] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.877260] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.877420] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.877561] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.877691] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.877844] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.878014] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.878176] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.878250] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.893696] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.893718] ACPI: button: Power Button [PWRB] [ 1.893740] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.893777] ACPI: button: Power Button [PWRF] [ 1.910502] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.910504] pstore: Registered erst as persistent store backend [ 1.910599] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.910684] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.918203] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.926802] Non-volatile memory driver v1.3 [ 1.934914] rdac: device handler registered [ 1.934945] hp_sw: device handler registered [ 1.934945] emc: device handler registered [ 1.934969] alua: device handler registered [ 1.935279] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.935316] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.935330] ehci-pci 0000:00:1d.0: debug port 2 [ 1.939258] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.945869] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.945960] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.945962] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.945963] usb usb1: Product: EHCI Host Controller [ 1.945964] usb usb1: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.945965] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.946093] hub 1-0:1.0: USB hub found [ 1.946101] hub 1-0:1.0: 2 ports detected [ 1.946289] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.946352] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.947445] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.947672] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.947675] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.947717] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 3 [ 1.947721] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 1.947723] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.947736] ehci-pci 0000:00:1a.0: debug port 2 [ 1.947765] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.947767] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.947768] usb usb2: Product: xHCI Host Controller [ 1.947769] usb usb2: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.947770] usb usb2: SerialNumber: 0000:00:14.0 [ 1.947886] hub 2-0:1.0: USB hub found [ 1.947919] hub 2-0:1.0: 15 ports detected [ 1.951129] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.951131] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.951133] usb usb4: Product: xHCI Host Controller [ 1.951134] usb usb4: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.951135] usb usb4: SerialNumber: 0000:00:14.0 [ 1.951235] hub 4-0:1.0: USB hub found [ 1.951250] hub 4-0:1.0: 6 ports detected [ 1.951660] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.952946] usbcore: registered new interface driver usbserial_generic [ 1.952952] usbserial: USB Serial support registered for generic [ 1.952985] i8042: PNP: No PS/2 controller found. [ 1.953015] mousedev: PS/2 mouse device common for all mice [ 1.953088] rtc_cmos 00:00: RTC can wake from S4 [ 1.953377] rtc_cmos 00:00: registered as rtc0 [ 1.953421] rtc_cmos 00:00: setting system clock to 2024-04-15T23:34:30 UTC (1713224070) [ 1.953448] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.957890] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.957933] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.957935] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.957936] usb usb3: Product: EHCI Host Controller [ 1.957937] usb usb3: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.957937] usb usb3: SerialNumber: 0000:00:1a.0 [ 1.958011] hub 3-0:1.0: USB hub found [ 1.958014] hub 3-0:1.0: 2 ports detected [ 1.979183] intel_pstate: Intel P-state driver initializing [ 2.010358] Freeing initrd memory: 31028K [ 2.016046] hid: raw HID events driver (C) Jiri Kosina [ 2.016091] usbcore: registered new interface driver usbhid [ 2.016091] usbhid: USB HID core driver [ 2.016140] drop_monitor: Initializing network drop monitor service [ 2.024894] Initializing XFRM netlink socket [ 2.024975] NET: Registered PF_INET6 protocol family [ 2.029889] Segment Routing with IPv6 [ 2.029907] NET: Registered PF_PACKET protocol family [ 2.029927] mpls_gso: MPLS GSO support [ 2.051631] microcode: Current revision: 0x0b000010 [ 2.085771] resctrl: L3 allocation detected [ 2.085773] resctrl: L3 monitoring detected [ 2.085785] IPI shorthand broadcast: enabled [ 2.085790] AVX2 version of gcm_enc/dec engaged. [ 2.147732] AES CTR mode by8 optimization enabled [ 2.147770] sched_clock: Marking stable (1019100873, 1127758117)->(2485962753, -339103763) [ 2.156074] registered taskstats version 1 [ 2.172714] Loading compiled-in X.509 certificates [ 2.173220] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.173486] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.173744] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.173902] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.173912] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.174074] zswap: loaded using pool lzo/zbud [ 2.183893] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.189080] page_owner is disabled [ 2.189246] pstore: Using crash dump compression: deflate [ 2.189256] Key type big_key registered [ 2.198896] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.207884] usb 3-1: new high-speed USB device number 2 using ehci-pci [ 2.314536] Key type encrypted registered [ 2.314548] ima: No TPM chip found, activating TPM-bypass! [ 2.314550] Loading compiled-in module X.509 certificates [ 2.314839] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.314842] ima: Allocated hash algorithm: sha256 [ 2.314850] ima: No architecture policies found [ 2.314856] evm: Initialising EVM extended attributes: [ 2.314856] evm: security.selinux [ 2.314857] evm: security.SMACK64 (disabled) [ 2.314858] evm: security.SMACK64EXEC (disabled) [ 2.314862] evm: security.SMACK64TRANSMUTE (disabled) [ 2.314862] evm: security.SMACK64MMAP (disabled) [ 2.314863] evm: security.apparmor (disabled) [ 2.314864] evm: security.ima [ 2.314864] evm: security.capability [ 2.314865] evm: HMAC attrs: 0x1 [ 2.320212] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.320214] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.320496] hub 1-1:1.0: USB hub found [ 2.320585] hub 1-1:1.0: 8 ports detected [ 2.325061] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.325064] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.325601] hub 2-12:1.0: USB hub found [ 2.325680] hub 2-12:1.0: 4 ports detected [ 2.341227] usb 3-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.341229] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.341499] hub 3-1:1.0: USB hub found [ 2.341587] hub 3-1:1.0: 6 ports detected [ 2.617885] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.722221] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.722223] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.727263] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.765888] tsc: Refined TSC clocksource calibration: 3499.994 MHz [ 2.765891] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734b4358f, max_idle_ns: 440795367814 ns [ 2.769153] clocksource: Switched to clocksource tsc [ 2.779000] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.781687] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.781758] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.174985] Freeing unused decrypted memory: 2028K [ 5.175436] Freeing unused kernel image (initmem) memory: 3932K [ 5.186910] Write protecting the kernel read-only data: 28672k [ 5.187360] Freeing unused kernel image (rodata/data gap) memory: 492K [ 5.226373] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.226374] x86/mm: Checking user space page tables [ 5.261111] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.261122] Run /init as init process [ 5.274817] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.274928] systemd[1]: Detected architecture x86-64. [ 5.274930] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-44.git20230822.el9 (Initramfs)! [ 5.326081] systemd[1]: Hostname set to . [ OK [[ 5.385457] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.385567] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.406983] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.421035] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.433008] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.443945] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.456162] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.471086] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.485014] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.497203] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.511142] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.524985] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.543576] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.558950] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.571599] systemd[1]: Starting Load Kernel Modules... g Load Kernel Modules... Startin[ 5.584472] systemd[1]: Starting Create System Users... g Create System Users... [ 5.592960] fuse: init (API version 7.36) Startin[ 5.599108] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.611614] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 5.988675] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Starte[ 6.019871] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.019873] igb: Copyright (c) 2007-2014 Intel Corporation. d Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target [0;1;39[ 6.041700] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.041702] ixgbe: Copyright (c) 1999-2016 Intel Corporation. mPath Units. [ OK ] Reached target Basic System. [ 6.064461] nvme nvme0: pci function 0000:02:00.0 [ 6.067416] nvme nvme0: 8/0/0 default/read/poll queues [ 6.079991] igb 0000:07:00.0: added PHC on eth0 [ 6.080010] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.080012] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:f0 [ 6.080095] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.080096] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.093698] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.093702] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.095126] ACPI: bus type drm_connector registered [ 6.105065] scsi host0: ahci [ 6.105194] scsi host1: ahci [ 6.105281] scsi host2: ahci [ 6.105368] scsi host3: ahci [ 6.105407] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 62 lpm-pol 0 [ 6.105409] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 62 lpm-pol 0 [ 6.105412] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 62 lpm-pol 0 [ 6.105415] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 62 lpm-pol 0 [ 6.105700] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.105703] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.120243] scsi host4: ahci [ 6.120340] scsi host5: ahci [ 6.120429] scsi host6: ahci [ 6.120516] scsi host7: ahci [ 6.120601] scsi host8: ahci [ 6.120689] scsi host9: ahci [ 6.120727] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 63 lpm-pol 0 [ 6.120729] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 63 lpm-pol 0 [ 6.120732] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 63 lpm-pol 0 [ 6.120734] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 63 lpm-pol 0 [ 6.120737] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 63 lpm-pol 0 [ 6.120739] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 63 lpm-pol 0 [ 6.137359] igb 0000:07:00.1: added PHC on eth1 [ 6.137389] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.137390] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:36:f1 [ 6.137474] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.137475] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.138584] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.145979] igb 0000:07:00 6.161185] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.169933] Console: switching to colour dummy device 80x25 [ 6.170068] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.170069] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.170079] ast 0000:06:00.0: [drm] Using analog VGA [ 6.170084] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.170230] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.179572] fbcon: astdrmfb (fb0) is primary device [ 6.204169] Console: switching to colour frame buffer device 128x48 [ 6.222915] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.411028] ata2: SATA link down (SStatus 0 SControl 300) [ 6.411071] ata3: SATA link down (SStatus 0 SControl 300) [ 6.411238] ata4: SATA link down (SStatus 0 SControl 300) [ 6.411461] ata1: SATA link down (SStatus 0 SControl 300) [ 6.426983] ata6: SATA link down (SStatus 0 SControl 300) [ 6.427011] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.427030] ata9: SATA link down (SStatus 0 SControl 300) [ 6.427071] ata8: SATA link down (SStatus 0 SControl 300) [ 6.427125] ata10: SATA link down (SStatus 0 SControl 300) [ 6.427148] ata7: SATA link down (SStatus 0 SControl 300] ata5.00: ATA-9, SN06, max UDMA17] ata5.00: NCQ Send/Recv Log not supported [ 6.428118] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.429524] ata5.00: NCQ Send/Recv Log not supported [ 6.429526] ata5.00: configured for UDMA/133 [ 6.429619] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.502755] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.566187] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.566203] sd 4:0:0:0: [sda] Write Protect is off [ 6.566226] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.566248] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.575296] sda: sda1 [ 6.575371] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.195296] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.195584] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.195666] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.195667] ixgbe 0000:03:00.0: 0c:c4:7a:88:80:80 [ 7.198715] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.356046] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.356333] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.356414] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.356416] ixgbe 0000:03:00.1: 0c:c4:7a:88:80:81 [ 7.359385] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.367618] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.400384] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…7844-4e73-a652-6bb884dfb0a5... [ OK ] Finished File System Check…0-7844-4e73-a652-6bb884dfb0a5. Mounting /sysroot... [ 7.633259] EXT4-fs (sda1): mounted filesystem 0b261d40-7844-4e73-a652-6bb884dfb0a5 ro with ordered data mode. Quota mode: none. [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Switch Root... [ 7.979139] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). [ 8.476818] SELinux: policy capability network_peer_controls=1 [ 8.476822] SELinux: policy capability open_perms=1 [ 8.476822] SELinux: policy capability extended_socket_class=1 [ 8.476823] SELinux: policy capability always_check_network=0 [ 8.476823] SELinux: policy capability cgroup_seclabel=1 [ 8.476823] SELinux: policy capability nnp_nosuid_transition=1 [ 8.476824] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.520330] audit: type=1403 audit(1713224077.065:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.522639] systemd[1]: Successfully loaded SELinux policy in 115.340ms. [ 8.602498] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 26.663ms. [ 8.616444] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.616548] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ OK [[ 9.718362] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.718456] systemd[1]: Stopped Switch Root. [ 9.718853] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.719202] systemd[1]: Created slice Slice /system/getty. [ 9.740715] systemd[1]: Created slice Slice /system/modprobe. 0m] Stopped Switch Root[ 9.752096] systemd[1]: Created slice Slice /system/serial-getty. [ 9.752378] systemd[1]: Created slice Slice /system/sshd-keygen. [ 9.752620] systemd[1]: Created slice User and Session Slice. [ 9.752651] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). [ 9.752744] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.753117] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. . [[ 9.804171] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ 9.804198] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.804214] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ 9.804229] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ 9.804243] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.804270] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. [ 9.804288] systemd[1]: Reached target Local Encrypted Volumes. [ 9.804313] systemd[1]: Stopped target Switch Root. [ 9.804332] systemd[1]: Stopped target Initrd File Systems. [ 9.804346] systemd[1]: Stopped target Initrd Root File System. [ 9.804361] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.804396] systemd[1]: Reached target Path Units. [ 9.804438] systemd[1]: Reached target Slice Units. [ 9.804458] systemd[1]: Reached target Swaps. [ 9.804474] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.804816] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ 9.805798] systemd[1]: Listening on LVM2 poll daemon socket. OK ] Created slice Slice /system/getty. [ OK ] Created slice Slice /system/modprobe[ 9.940357] systemd[1]: Listening on RPCbind Server Activation Socket. [0m. [ [ 9.940414] systemd[1]: Reached target RPC Port Mapper. [ 9.951625] systemd[1]: Listening on Process Core Dump Socket. OK ] Creat[ 9.960547] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 9.961330] systemd[1]: Listening on udev Control Socket. ed slice [0;1;3[ 9.973994] systemd[1]: Listening on udev Kernel Socket. 9mSlice /system/serial-getty. [ OK ] Created slice S[ 9.986026] systemd[1]: Mounting Huge Pages File System... [ 9.986925] systemd[1]: Mounting POSIX Message Queue File System... lice /system/sshd-keygen. [ 9.999972] systemd[1]: Mounting Kernel Debug File System... [ 10.000794] systemd[1]: Mounting Kernel Trace File System... [ 10.000933] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). [ 10.024147] systemd[1]: Starting Create List of Static Device Nodes... [ OK [[ 10.033794] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... [ 10.034693] systemd[1]: Starting Load Kernel Module configfs... 0m] Created slice User [ 10.051373] systemd[1]: Starting Load Kernel Module drm... [ 10.052181] systemd[1]: Starting Load Kernel Module fuse... and Session Slice. [[0;32[ 10.065848] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... [ 10.065944] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.065996] systemd[1]: Stopped Plymouth switch root service. m OK ] Sta[ 10.083075] systemd[1]: Stopped Journal Service. rted Forward Password R[ 10.095869] systemd[1]: Starting Journal Service... [ 10.097808] systemd[1]: Starting Load Kernel Modules... …uests to Wall Directory Watch[ 10.108220] systemd[1]: Starting Generate network units from Kernel command line... . [[ 10.109040] systemd[1]: Starting Remount Root and Kernel File Systems... OK ] Set [ 10.126001] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.126848] systemd[1]: Starting Coldplug All udev Devices... [ 10.128501] systemd[1]: Mounted Huge Pages File System. up automount [0[ 10.142628] systemd[1]: Mounted POSIX Message Queue File System. [ 10.147842] systemd[1]: Mounted Kernel Debug File System. [ 10.148043] systemd[1]: Mounted Kernel Trace File System. ;1;39mArbitrary\xe2[ 10.155498] EXT4-fs (sda1): re-mounted 0b261d40-7844-4e73-a652-6bb884dfb0a5 r/w. Quota mode: none. [ 10.161455] systemd[1]: Finished Create List of Static Device Nodes. \x80\xa6s File System Automount Point[ 10.182884] systemd[1]: modprobe@drm.service: Deactivated successfully. [ 10.182991] systemd[1]: Finished Load Kernel Module drm. [ 10.183203] systemd[1]: modprobe@fuse.service: Deactivated successfully. [ 10.183291] systemd[1]: Finished Load Kernel Module fuse. [0m. [ [ 10.183567] systemd[1]: Finished Read and set NIS domainname from /etc/sysconfig/network. [ 10.183843] systemd[1]: Finished Generate network units from Kernel command line. [ 10.184079] systemd[1]: Finished Remount Root and Kernel File Systems. [ 10.192123] systemd[1]: Reached target Preparation for Network. [ 10.235070] systemd[1]: Mounting FUSE Control File System... OK ] Reach[ 10.244473] systemd[1]: First Boot Wizard was skipped because of an unmet condition check (ConditionFirstBoot=yes). ed target [0;1;[ 10.251818] systemd[1]: Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc). [ 10.252802] systemd[1]: Starting Load/Save Random Seed... 39mceph target\xe2\x80[ 10.256304] systemd[1]: Create System Users was skipped because no trigger condition checks were met. [ 10.257153] systemd[1]: Starting Create Static Device Nodes in /dev... \xa6on@.service ins[ 10.275576] systemd[1]: Started Journal Service. tances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached target Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll [ 10.406427] systemd-journald[572]: Received client request to flush runtime journal. daemon socket. [ OK ] Listeni[ 10.416894] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. ng on R[ 10.416911] device-mapper: uevent: version 1.0.3 [ 10.416995] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com PCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System... Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Starting Load/Save Random Seed... Starting Create Static Device Nodes in /dev... [ OK ] Started Journal Service. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Modules. [ OK ] Mounted FUSE Control File System. Mounting Kernel Configuration File System... Starting Flush Journal to Persistent Storage... Starting Apply Kernel Variables... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs[ 10.817128] IPMI message handler: version 39.2 . [ OK ] Finished Lo[ 10.825114] ipmi device interface ad Kernel Module fuse. [ OK ] Finished [0;1;[ 10.833869] ipmi_si: IPMI System Interface driver 39mAutomatic Boo[ 10.833883] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.833885] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.833887] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.833925] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.833993] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.834300] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI t Loader Update[ 10.834302] ipmi_si: Adding ACPI-specified kcs state machine [ 10.834351] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [0m. [ OK ] Finis[ 10.902271] power_meter ACPI000D:00: Found ACPI power meter. hed Tel[ 10.902422] power_meter ACPI000D:00: Ignoring unsafe software power cap! l Plymouth To Wr[ 10.902429] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). ite Out Runtime [ 10.916586] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. Data. [ 10.942126] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 10.956524] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.965087] igb 0000:07:00.0: DCA enabled [ 10.965101] igb 0000:07:00.1: DCA enabled [ 10.974128] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.981021] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 10.991875] ipmi_ssif: IPMI SSIF Interface driver [ 11.004468] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.037233] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.037900] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 11.037902] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 11.075001] iTCO_vendor_support: vendor-support=0 [ 11.081717] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.082400] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.082402] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.082403] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.085000] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Finished Create Volatile Files and Directories. Starting Security Auditing Service... Starting RPC Bind... Mounting RPC Pipe File System... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... [ OK ] Started RPC Bind[0[ 11.378149] RPC: Registered named UNIX socket transport module. m. [ 11.378151] RPC: Registered udp transport module. [ OK ] Mounted RPC Pipe Fi[ 11.378152] RPC: Registered tcp transport module. le System. [ 11.378152] RPC: Registered tcp-with-tls transport module. [ 11.378153] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Reached target rpc_pipefs.target. [ OK [[ 11.637645] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled 0m] Started Security Au[ 11.647749] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. diting Service[[ 11.647780] XFS (dm-4): Mounting V4 Filesystem 55c03363-80f4-45b9-9199-da1d41cb24f0 [ 11.650627] XFS (dm-4): Ending clean mount 0m. [ 11.650677] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) Starting Record System Boot/Shutdown in UTMP... [ OK ] Mounted /var/lib/ceph. [ 11.698955] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.698956] EDAC sbridge: Ver: 1.1.2 [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK [[ 11.749094] intel_rapl_common: Found RAPL domain package [ 11.749101] intel_rapl_common: Found RAPL domain dram 0m] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Authorization Manager... Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Started User Login Management. [ OK ] Finished Resets System Activity Logs. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started NTP client/server. Starting Hostname Service... [ OK ] Started Hostname Service. [* ] (1 of 2) A start job is running for…horization Manager (5s / no limit) M [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. [ OK ] Started Authorization Manager. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.740820] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.897158] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... [ 16.122086] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ 16.318002] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.318116] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network Manager Wait Online (9s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ **] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. [ OK ] Started System Logging Service. + myips=172.21.15.195 + attempts=1 + sleep 1 + '[' 172.21.15.195 '!=' '' ']' + set -e + '[' -n 172.21.15.195 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.195 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.195 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' Starting SETroubleshoot da…ing new SELinux denial logs... + newhostname=smithi195.front.sepia.ceph.com + '[' -n smithi195.front.sepia.ceph.com ']' + hostname smithi195.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi195 + echo smithi195 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.195 smithi195.front.sepia.ceph.com smithi195/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ 26.159824] block sda: the capability attribute has been deprecated. CentOS Stream 9 Kernel 5.14.0-438.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi195 login: [disconnect] 2024-04-15T23:34:58.234 INFO:teuthology.misc:Re-opening connections... 2024-04-15T23:34:58.234 INFO:teuthology.misc:trying to connect to ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:34:58.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:34:58.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:34:58.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~164s 2024-04-15T23:34:58.703 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-04-15T23:34:59.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-04-15T23:34:59.212 DEBUG:teuthology.misc:waited 0.9777383804321289 2024-04-15T23:35:00.213 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:35:00.213 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi195.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-04-15T23:35:00.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-15T23:35:00.305 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T23:35:00.346 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-15T23:35:00.347 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-15T23:35:00.389 INFO:tasks.ceph.osd.2:Started 2024-04-15T23:35:00.389 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:35:00.508 INFO:teuthology.orchestra.run.smithi195.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-15T23:35:00.511 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-15T23:35:00.511 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-15T23:35:01.414 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:35:01.431+0000 7fcce4c1a640 -1 Falling back to public interface 2024-04-15T23:35:04.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-15T23:35:05.012 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:35:05.029+0000 7fcce4c1a640 -1 osd.2 23 log_to_monitors true 2024-04-15T23:35:05.512 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:35:05.625 INFO:teuthology.orchestra.run.smithi195.stderr:no valid command found; 10 closest matches: 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:0 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:1 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:2 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:abort 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:assert 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:bluefs debug_inject_read_zeros 2024-04-15T23:35:05.626 INFO:teuthology.orchestra.run.smithi195.stderr:bluefs files list 2024-04-15T23:35:05.627 INFO:teuthology.orchestra.run.smithi195.stderr:bluefs stats 2024-04-15T23:35:05.627 INFO:teuthology.orchestra.run.smithi195.stderr:bluestore allocator dump block 2024-04-15T23:35:05.627 INFO:teuthology.orchestra.run.smithi195.stderr:bluestore allocator fragmentation block 2024-04-15T23:35:05.627 INFO:teuthology.orchestra.run.smithi195.stderr:admin_socket: invalid command 2024-04-15T23:35:05.627 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-15T23:35:05.628 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-15T23:35:05.889 INFO:tasks.ceph.osd.2.smithi195.stderr:2024-04-15T23:35:05.906+0000 7fccd841b640 -1 osd.2 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T23:35:10.629 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-15T23:35:10.746 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2024-04-15T23:35:10.746 INFO:teuthology.orchestra.run.smithi195.stdout: "ops": [], 2024-04-15T23:35:10.746 INFO:teuthology.orchestra.run.smithi195.stdout: "num_ops": 0 2024-04-15T23:35:10.746 INFO:teuthology.orchestra.run.smithi195.stdout:} 2024-04-15T23:35:10.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-15T23:35:11.278 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.0 to 1 (10000) 2024-04-15T23:35:11.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-15T23:35:12.276 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.1 to 1 (10000) 2024-04-15T23:35:12.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-15T23:35:13.277 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.2 to 1 (10000) 2024-04-15T23:35:13.294 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-15T23:35:13.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:35:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:13.597 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:35:13.605 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-04-15T23:35:13.293290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":441,"num_bytes_recovered":17538746,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":227236,"kb_used_data":133180,"kb_used_omap":9,"kb_used_meta":94006,"kb_avail":282888284,"statfs":{"total":289910292480,"available":289677602816,"internally_reserved":0,"allocated":136376320,"data_stored":121091660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":96262257},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":440,"num_bytes_recovered":13344442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.466457"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":253,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.903354+0000","last_change":"2024-04-15T23:35:07.905709+0000","last_active":"2024-04-15T23:35:06.903354+0000","last_peered":"2024-04-15T23:35:06.094422+0000","last_clean":"2024-04-15T23:32:07.534338+0000","last_became_active":"2024-04-15T23:32:11.544352+0000","last_became_peered":"2024-04-15T23:32:11.544352+0000","last_unstale":"2024-04-15T23:35:06.903354+0000","last_undegraded":"2024-04-15T23:35:06.903354+0000","last_fullsized":"2024-04-15T23:35:06.903354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":251,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900000+0000","last_change":"2024-04-15T23:35:07.903037+0000","last_active":"2024-04-15T23:35:06.900000+0000","last_peered":"2024-04-15T23:35:06.093690+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:32:11.543124+0000","last_became_peered":"2024-04-15T23:32:11.543124+0000","last_unstale":"2024-04-15T23:35:06.900000+0000","last_undegraded":"2024-04-15T23:35:06.900000+0000","last_fullsized":"2024-04-15T23:35:06.900000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":270,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900211+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:35:07.900211+0000","last_peered":"2024-04-15T23:35:07.900211+0000","last_clean":"2024-04-15T23:35:07.900211+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:35:07.900211+0000","last_undegraded":"2024-04-15T23:35:07.900211+0000","last_fullsized":"2024-04-15T23:35:07.900211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":229,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.905148+0000","last_change":"2024-04-15T23:35:07.900511+0000","last_active":"2024-04-15T23:35:06.905148+0000","last_peered":"2024-04-15T23:35:05.896012+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:32:11.545419+0000","last_became_peered":"2024-04-15T23:32:11.545419+0000","last_unstale":"2024-04-15T23:35:06.905148+0000","last_undegraded":"2024-04-15T23:35:06.905148+0000","last_fullsized":"2024-04-15T23:35:06.905148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":274,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.898909+0000","last_change":"2024-04-15T23:35:07.902966+0000","last_active":"2024-04-15T23:35:06.898909+0000","last_peered":"2024-04-15T23:35:06.093434+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:32:11.543474+0000","last_became_peered":"2024-04-15T23:32:11.543474+0000","last_unstale":"2024-04-15T23:35:06.898909+0000","last_undegraded":"2024-04-15T23:35:06.898909+0000","last_fullsized":"2024-04-15T23:35:06.898909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":274,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.903072+0000","last_change":"2024-04-15T23:35:07.899621+0000","last_active":"2024-04-15T23:35:06.903072+0000","last_peered":"2024-04-15T23:35:05.895581+0000","last_clean":"2024-04-15T23:32:07.786325+0000","last_became_active":"2024-04-15T23:32:11.545668+0000","last_became_peered":"2024-04-15T23:32:11.545668+0000","last_unstale":"2024-04-15T23:35:06.903072+0000","last_undegraded":"2024-04-15T23:35:06.903072+0000","last_fullsized":"2024-04-15T23:35:06.903072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":267,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.905135+0000","last_change":"2024-04-15T23:35:07.905804+0000","last_active":"2024-04-15T23:35:06.905135+0000","last_peered":"2024-04-15T23:35:05.896424+0000","last_clean":"2024-04-15T23:32:07.786350+0000","last_became_active":"2024-04-15T23:32:11.546347+0000","last_became_peered":"2024-04-15T23:32:11.546347+0000","last_unstale":"2024-04-15T23:35:06.905135+0000","last_undegraded":"2024-04-15T23:35:06.905135+0000","last_fullsized":"2024-04-15T23:35:06.905135+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":244,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.904255+0000","last_change":"2024-04-15T23:35:07.899337+0000","last_active":"2024-04-15T23:35:06.904255+0000","last_peered":"2024-04-15T23:35:05.895492+0000","last_clean":"2024-04-15T23:32:07.786081+0000","last_became_active":"2024-04-15T23:32:11.545203+0000","last_became_peered":"2024-04-15T23:32:11.545203+0000","last_unstale":"2024-04-15T23:35:06.904255+0000","last_undegraded":"2024-04-15T23:35:06.904255+0000","last_fullsized":"2024-04-15T23:35:06.904255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":241,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.094642+0000","last_change":"2024-04-15T23:35:07.906227+0000","last_active":"2024-04-15T23:35:07.906227+0000","last_peered":"2024-04-15T23:35:06.094642+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545953+0000","last_became_peered":"2024-04-15T23:32:11.545953+0000","last_unstale":"2024-04-15T23:35:06.094642+0000","last_undegraded":"2024-04-15T23:33:04.251389+0000","last_fullsized":"2024-04-15T23:32:11.541547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":253,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900167+0000","last_change":"2024-04-15T23:35:07.904521+0000","last_active":"2024-04-15T23:35:06.900167+0000","last_peered":"2024-04-15T23:35:06.094129+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:32:11.543541+0000","last_became_peered":"2024-04-15T23:32:11.543541+0000","last_unstale":"2024-04-15T23:35:06.900167+0000","last_undegraded":"2024-04-15T23:35:06.900167+0000","last_fullsized":"2024-04-15T23:35:06.900167+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":252,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.902952+0000","last_change":"2024-04-15T23:35:07.901674+0000","last_active":"2024-04-15T23:35:06.902952+0000","last_peered":"2024-04-15T23:35:05.896861+0000","last_clean":"2024-04-15T23:32:07.786647+0000","last_became_active":"2024-04-15T23:32:11.545422+0000","last_became_peered":"2024-04-15T23:32:11.545422+0000","last_unstale":"2024-04-15T23:35:06.902952+0000","last_undegraded":"2024-04-15T23:35:06.902952+0000","last_fullsized":"2024-04-15T23:35:06.902952+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":242,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902178+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:35:07.902178+0000","last_peered":"2024-04-15T23:35:07.902178+0000","last_clean":"2024-04-15T23:35:07.902178+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:35:07.902178+0000","last_undegraded":"2024-04-15T23:35:07.902178+0000","last_fullsized":"2024-04-15T23:35:07.902178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":236,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.897574+0000","last_change":"2024-04-15T23:35:07.902161+0000","last_active":"2024-04-15T23:35:06.897574+0000","last_peered":"2024-04-15T23:35:06.093005+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:32:11.543005+0000","last_became_peered":"2024-04-15T23:32:11.543005+0000","last_unstale":"2024-04-15T23:35:06.897574+0000","last_undegraded":"2024-04-15T23:35:06.897574+0000","last_fullsized":"2024-04-15T23:35:06.897574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":278,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.899042+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:35:07.899042+0000","last_peered":"2024-04-15T23:35:07.899042+0000","last_clean":"2024-04-15T23:35:07.899042+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:35:07.899042+0000","last_undegraded":"2024-04-15T23:35:07.899042+0000","last_fullsized":"2024-04-15T23:35:07.899042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":258,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900937+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:35:07.900937+0000","last_peered":"2024-04-15T23:35:07.900937+0000","last_clean":"2024-04-15T23:35:07.900937+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:35:07.900937+0000","last_undegraded":"2024-04-15T23:35:07.900937+0000","last_fullsized":"2024-04-15T23:35:07.900937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":278,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.905190+0000","last_change":"2024-04-15T23:35:07.899944+0000","last_active":"2024-04-15T23:35:06.905190+0000","last_peered":"2024-04-15T23:35:05.895520+0000","last_clean":"2024-04-15T23:32:07.786096+0000","last_became_active":"2024-04-15T23:32:11.546233+0000","last_became_peered":"2024-04-15T23:32:11.546233+0000","last_unstale":"2024-04-15T23:35:06.905190+0000","last_undegraded":"2024-04-15T23:35:06.905190+0000","last_fullsized":"2024-04-15T23:35:06.905190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":239,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093791+0000","last_change":"2024-04-15T23:35:07.904671+0000","last_active":"2024-04-15T23:35:07.904671+0000","last_peered":"2024-04-15T23:35:06.093791+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543951+0000","last_became_peered":"2024-04-15T23:32:11.543951+0000","last_unstale":"2024-04-15T23:35:06.093791+0000","last_undegraded":"2024-04-15T23:33:04.222718+0000","last_fullsized":"2024-04-15T23:32:11.540820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":251,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.903258+0000","last_change":"2024-04-15T23:35:07.905647+0000","last_active":"2024-04-15T23:35:06.903258+0000","last_peered":"2024-04-15T23:35:06.094353+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:32:11.546238+0000","last_became_peered":"2024-04-15T23:32:11.546238+0000","last_unstale":"2024-04-15T23:35:06.903258+0000","last_undegraded":"2024-04-15T23:35:06.903258+0000","last_fullsized":"2024-04-15T23:35:06.903258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":218,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093128+0000","last_change":"2024-04-15T23:35:07.902727+0000","last_active":"2024-04-15T23:35:07.902727+0000","last_peered":"2024-04-15T23:35:06.093128+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:35:06.093128+0000","last_undegraded":"2024-04-15T23:33:04.197729+0000","last_fullsized":"2024-04-15T23:32:11.541074+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":299,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.904800+0000","last_change":"2024-04-15T23:35:07.901046+0000","last_active":"2024-04-15T23:35:06.904800+0000","last_peered":"2024-04-15T23:35:05.896676+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:32:11.546261+0000","last_became_peered":"2024-04-15T23:32:11.546261+0000","last_unstale":"2024-04-15T23:35:06.904800+0000","last_undegraded":"2024-04-15T23:35:06.904800+0000","last_fullsized":"2024-04-15T23:35:06.904800+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":263,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.907295+0000","last_change":"2024-04-15T23:35:07.916950+0000","last_active":"2024-04-15T23:35:06.907295+0000","last_peered":"2024-04-15T23:35:05.896434+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:32:11.545687+0000","last_became_peered":"2024-04-15T23:32:11.545687+0000","last_unstale":"2024-04-15T23:35:06.907295+0000","last_undegraded":"2024-04-15T23:35:06.907295+0000","last_fullsized":"2024-04-15T23:35:06.907295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":271,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901741+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:35:07.901741+0000","last_peered":"2024-04-15T23:35:07.901741+0000","last_clean":"2024-04-15T23:35:07.901741+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:35:07.901741+0000","last_undegraded":"2024-04-15T23:35:07.901741+0000","last_fullsized":"2024-04-15T23:35:07.901741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.294643+0000","last_change":"2024-04-15T23:35:10.294643+0000","last_active":"2024-04-15T23:35:10.294643+0000","last_peered":"2024-04-15T23:35:10.294643+0000","last_clean":"2024-04-15T23:35:10.294643+0000","last_became_active":"2024-04-15T23:35:10.293497+0000","last_became_peered":"2024-04-15T23:35:10.293497+0000","last_unstale":"2024-04-15T23:35:10.294643+0000","last_undegraded":"2024-04-15T23:35:10.294643+0000","last_fullsized":"2024-04-15T23:35:10.294643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:12:59.503325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":266,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.897533+0000","last_change":"2024-04-15T23:35:07.901061+0000","last_active":"2024-04-15T23:35:06.897533+0000","last_peered":"2024-04-15T23:35:06.092556+0000","last_clean":"2024-04-15T23:32:07.533578+0000","last_became_active":"2024-04-15T23:32:11.541949+0000","last_became_peered":"2024-04-15T23:32:11.541949+0000","last_unstale":"2024-04-15T23:35:06.897533+0000","last_undegraded":"2024-04-15T23:35:06.897533+0000","last_fullsized":"2024-04-15T23:35:06.897533+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":257,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.904888+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:35:07.904888+0000","last_peered":"2024-04-15T23:35:07.904888+0000","last_clean":"2024-04-15T23:35:07.904888+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:35:07.904888+0000","last_undegraded":"2024-04-15T23:35:07.904888+0000","last_fullsized":"2024-04-15T23:35:07.904888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":264,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.897597+0000","last_change":"2024-04-15T23:35:07.916714+0000","last_active":"2024-04-15T23:35:07.916714+0000","last_peered":"2024-04-15T23:35:05.897597+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:35:05.897597+0000","last_undegraded":"2024-04-15T23:33:01.567164+0000","last_fullsized":"2024-04-15T23:32:11.544630+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":261,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900823+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:35:07.900823+0000","last_peered":"2024-04-15T23:35:07.900823+0000","last_clean":"2024-04-15T23:35:07.900823+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:35:07.900823+0000","last_undegraded":"2024-04-15T23:35:07.900823+0000","last_fullsized":"2024-04-15T23:35:07.900823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":252,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903539+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:35:07.903539+0000","last_peered":"2024-04-15T23:35:07.903539+0000","last_clean":"2024-04-15T23:35:07.903539+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:35:07.903539+0000","last_undegraded":"2024-04-15T23:35:07.903539+0000","last_fullsized":"2024-04-15T23:35:07.903539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":241,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092822+0000","last_change":"2024-04-15T23:35:07.901559+0000","last_active":"2024-04-15T23:35:07.901559+0000","last_peered":"2024-04-15T23:35:06.092822+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.541839+0000","last_became_peered":"2024-04-15T23:32:11.541839+0000","last_unstale":"2024-04-15T23:35:06.092822+0000","last_undegraded":"2024-04-15T23:33:03.941073+0000","last_fullsized":"2024-04-15T23:32:11.539929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":294,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902056+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:35:07.902056+0000","last_peered":"2024-04-15T23:35:07.902056+0000","last_clean":"2024-04-15T23:35:07.902056+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:35:07.902056+0000","last_undegraded":"2024-04-15T23:35:07.902056+0000","last_fullsized":"2024-04-15T23:35:07.902056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":271,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.299527+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:35:10.299527+0000","last_peered":"2024-04-15T23:35:10.299527+0000","last_clean":"2024-04-15T23:35:10.299527+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:35:10.299527+0000","last_undegraded":"2024-04-15T23:35:10.299527+0000","last_fullsized":"2024-04-15T23:35:10.299527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":282,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900728+0000","last_change":"2024-04-15T23:35:07.900222+0000","last_active":"2024-04-15T23:35:06.900728+0000","last_peered":"2024-04-15T23:35:05.895712+0000","last_clean":"2024-04-15T23:32:07.786183+0000","last_became_active":"2024-04-15T23:32:11.545613+0000","last_became_peered":"2024-04-15T23:32:11.545613+0000","last_unstale":"2024-04-15T23:35:06.900728+0000","last_undegraded":"2024-04-15T23:35:06.900728+0000","last_fullsized":"2024-04-15T23:35:06.900728+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":254,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.901126+0000","last_change":"2024-04-15T23:35:07.904154+0000","last_active":"2024-04-15T23:35:06.901126+0000","last_peered":"2024-04-15T23:35:06.094119+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:32:11.543993+0000","last_became_peered":"2024-04-15T23:32:11.543993+0000","last_unstale":"2024-04-15T23:35:06.901126+0000","last_undegraded":"2024-04-15T23:35:06.901126+0000","last_fullsized":"2024-04-15T23:35:06.901126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":235,"reported_epoch":59,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:07.916920+0000","last_change":"2024-04-15T23:35:07.916920+0000","last_active":"2024-04-15T23:35:06.907266+0000","last_peered":"2024-04-15T23:35:05.896729+0000","last_clean":"2024-04-15T23:32:07.786667+0000","last_became_active":"2024-04-15T23:32:11.547544+0000","last_became_peered":"2024-04-15T23:32:11.547544+0000","last_unstale":"2024-04-15T23:35:07.916920+0000","last_undegraded":"2024-04-15T23:35:07.916920+0000","last_fullsized":"2024-04-15T23:35:07.916920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":253,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900727+0000","last_change":"2024-04-15T23:35:07.901240+0000","last_active":"2024-04-15T23:35:06.900727+0000","last_peered":"2024-04-15T23:35:06.093786+0000","last_clean":"2024-04-15T23:32:07.534221+0000","last_became_active":"2024-04-15T23:32:11.543376+0000","last_became_peered":"2024-04-15T23:32:11.543376+0000","last_unstale":"2024-04-15T23:35:06.900727+0000","last_undegraded":"2024-04-15T23:35:06.900727+0000","last_fullsized":"2024-04-15T23:35:06.900727+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290951+0000","last_change":"2024-04-15T23:35:07.923327+0000","last_active":"2024-04-15T23:35:10.290951+0000","last_peered":"2024-04-15T23:35:10.290951+0000","last_clean":"2024-04-15T23:35:10.290951+0000","last_became_active":"2024-04-15T23:35:07.923022+0000","last_became_peered":"2024-04-15T23:35:07.923022+0000","last_unstale":"2024-04-15T23:35:10.290951+0000","last_undegraded":"2024-04-15T23:35:10.290951+0000","last_fullsized":"2024-04-15T23:35:10.290951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:56.197588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":266,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.896869+0000","last_change":"2024-04-15T23:35:07.901247+0000","last_active":"2024-04-15T23:35:07.901247+0000","last_peered":"2024-04-15T23:35:05.896869+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546377+0000","last_became_peered":"2024-04-15T23:32:11.546377+0000","last_unstale":"2024-04-15T23:35:05.896869+0000","last_undegraded":"2024-04-15T23:33:04.211090+0000","last_fullsized":"2024-04-15T23:32:11.543483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903065+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:35:07.903065+0000","last_peered":"2024-04-15T23:35:07.903065+0000","last_clean":"2024-04-15T23:35:07.903065+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:35:07.903065+0000","last_undegraded":"2024-04-15T23:35:07.903065+0000","last_fullsized":"2024-04-15T23:35:07.903065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":252,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.896657+0000","last_change":"2024-04-15T23:35:07.900977+0000","last_active":"2024-04-15T23:35:07.900977+0000","last_peered":"2024-04-15T23:35:05.896657+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547018+0000","last_became_peered":"2024-04-15T23:32:11.547018+0000","last_unstale":"2024-04-15T23:35:05.896657+0000","last_undegraded":"2024-04-15T23:33:04.171797+0000","last_fullsized":"2024-04-15T23:32:11.543473+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":112,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900150+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:35:07.900150+0000","last_peered":"2024-04-15T23:35:07.900150+0000","last_clean":"2024-04-15T23:35:07.900150+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:35:07.900150+0000","last_undegraded":"2024-04-15T23:35:07.900150+0000","last_fullsized":"2024-04-15T23:35:07.900150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":104,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901535+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:35:07.901535+0000","last_peered":"2024-04-15T23:35:07.901535+0000","last_clean":"2024-04-15T23:35:07.901535+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:35:07.901535+0000","last_undegraded":"2024-04-15T23:35:07.901535+0000","last_fullsized":"2024-04-15T23:35:07.901535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":254,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902492+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:35:07.902492+0000","last_peered":"2024-04-15T23:35:07.902492+0000","last_clean":"2024-04-15T23:35:07.902492+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:35:07.902492+0000","last_undegraded":"2024-04-15T23:35:07.902492+0000","last_fullsized":"2024-04-15T23:35:07.902492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":106,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.904890+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:35:07.904890+0000","last_peered":"2024-04-15T23:35:07.904890+0000","last_clean":"2024-04-15T23:35:07.904890+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:35:07.904890+0000","last_undegraded":"2024-04-15T23:35:07.904890+0000","last_fullsized":"2024-04-15T23:35:07.904890+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":285,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.897659+0000","last_change":"2024-04-15T23:35:06.897659+0000","last_active":"2024-04-15T23:35:06.897659+0000","last_peered":"2024-04-15T23:35:06.092691+0000","last_clean":"2024-04-15T23:35:06.092691+0000","last_became_active":"2024-04-15T23:32:52.246717+0000","last_became_peered":"2024-04-15T23:32:52.246717+0000","last_unstale":"2024-04-15T23:35:06.897659+0000","last_undegraded":"2024-04-15T23:35:06.897659+0000","last_fullsized":"2024-04-15T23:35:06.897659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":104,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905385+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:35:07.905385+0000","last_peered":"2024-04-15T23:35:07.905385+0000","last_clean":"2024-04-15T23:35:07.905385+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:35:07.905385+0000","last_undegraded":"2024-04-15T23:35:07.905385+0000","last_fullsized":"2024-04-15T23:35:07.905385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":248,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.906218+0000","last_change":"2024-04-15T23:35:07.900037+0000","last_active":"2024-04-15T23:35:06.906218+0000","last_peered":"2024-04-15T23:35:05.895990+0000","last_clean":"2024-04-15T23:32:07.786434+0000","last_became_active":"2024-04-15T23:32:11.547212+0000","last_became_peered":"2024-04-15T23:32:11.547212+0000","last_unstale":"2024-04-15T23:35:06.906218+0000","last_undegraded":"2024-04-15T23:35:06.906218+0000","last_fullsized":"2024-04-15T23:35:06.906218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923940+0000","last_change":"2024-04-15T23:35:07.923940+0000","last_active":"2024-04-15T23:35:07.923940+0000","last_peered":"2024-04-15T23:35:07.923940+0000","last_clean":"2024-04-15T23:35:07.923940+0000","last_became_active":"2024-04-15T23:35:07.923559+0000","last_became_peered":"2024-04-15T23:35:07.923559+0000","last_unstale":"2024-04-15T23:35:07.923940+0000","last_undegraded":"2024-04-15T23:35:07.923940+0000","last_fullsized":"2024-04-15T23:35:07.923940+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:34.992257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":230,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.895674+0000","last_change":"2024-04-15T23:35:07.901912+0000","last_active":"2024-04-15T23:35:07.901912+0000","last_peered":"2024-04-15T23:35:05.895674+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545235+0000","last_became_peered":"2024-04-15T23:32:11.545235+0000","last_unstale":"2024-04-15T23:35:05.895674+0000","last_undegraded":"2024-04-15T23:33:04.172129+0000","last_fullsized":"2024-04-15T23:32:11.542558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291162+0000","last_change":"2024-04-15T23:35:07.979404+0000","last_active":"2024-04-15T23:35:10.291162+0000","last_peered":"2024-04-15T23:35:10.291162+0000","last_clean":"2024-04-15T23:35:10.291162+0000","last_became_active":"2024-04-15T23:35:07.924742+0000","last_became_peered":"2024-04-15T23:35:07.924742+0000","last_unstale":"2024-04-15T23:35:10.291162+0000","last_undegraded":"2024-04-15T23:35:10.291162+0000","last_fullsized":"2024-04-15T23:35:10.291162+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:59.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":281,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.906545+0000","last_change":"2024-04-15T23:35:07.902310+0000","last_active":"2024-04-15T23:35:06.906545+0000","last_peered":"2024-04-15T23:35:05.896597+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:32:11.545650+0000","last_became_peered":"2024-04-15T23:32:11.545650+0000","last_unstale":"2024-04-15T23:35:06.906545+0000","last_undegraded":"2024-04-15T23:35:06.906545+0000","last_fullsized":"2024-04-15T23:35:06.906545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919642+0000","last_change":"2024-04-15T23:35:07.919642+0000","last_active":"2024-04-15T23:35:07.919642+0000","last_peered":"2024-04-15T23:35:07.919642+0000","last_clean":"2024-04-15T23:35:07.919642+0000","last_became_active":"2024-04-15T23:35:07.919354+0000","last_became_peered":"2024-04-15T23:35:07.919354+0000","last_unstale":"2024-04-15T23:35:07.919642+0000","last_undegraded":"2024-04-15T23:35:07.919642+0000","last_fullsized":"2024-04-15T23:35:07.919642+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:24.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":267,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901442+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:35:07.901442+0000","last_peered":"2024-04-15T23:35:07.901442+0000","last_clean":"2024-04-15T23:35:07.901442+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:35:07.901442+0000","last_undegraded":"2024-04-15T23:35:07.901442+0000","last_fullsized":"2024-04-15T23:35:07.901442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903580+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:35:07.903580+0000","last_peered":"2024-04-15T23:35:07.903580+0000","last_clean":"2024-04-15T23:35:07.903580+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:35:07.903580+0000","last_undegraded":"2024-04-15T23:35:07.903580+0000","last_fullsized":"2024-04-15T23:35:07.903580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":239,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.916094+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:35:07.916094+0000","last_peered":"2024-04-15T23:35:07.916094+0000","last_clean":"2024-04-15T23:35:07.916094+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:35:07.916094+0000","last_undegraded":"2024-04-15T23:35:07.916094+0000","last_fullsized":"2024-04-15T23:35:07.916094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.909057+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:35:07.909057+0000","last_peered":"2024-04-15T23:35:07.909057+0000","last_clean":"2024-04-15T23:35:07.909057+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:35:07.909057+0000","last_undegraded":"2024-04-15T23:35:07.909057+0000","last_fullsized":"2024-04-15T23:35:07.909057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":219,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093956+0000","last_change":"2024-04-15T23:35:07.903520+0000","last_active":"2024-04-15T23:35:07.903520+0000","last_peered":"2024-04-15T23:35:06.093956+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543916+0000","last_became_peered":"2024-04-15T23:32:11.543916+0000","last_unstale":"2024-04-15T23:35:06.093956+0000","last_undegraded":"2024-04-15T23:33:04.173908+0000","last_fullsized":"2024-04-15T23:32:11.540434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":305,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900727+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:35:07.900727+0000","last_peered":"2024-04-15T23:35:07.900727+0000","last_clean":"2024-04-15T23:35:07.900727+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:35:07.900727+0000","last_undegraded":"2024-04-15T23:35:07.900727+0000","last_fullsized":"2024-04-15T23:35:07.900727+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919572+0000","last_change":"2024-04-15T23:35:07.919572+0000","last_active":"2024-04-15T23:35:07.919572+0000","last_peered":"2024-04-15T23:35:07.919572+0000","last_clean":"2024-04-15T23:35:07.919572+0000","last_became_active":"2024-04-15T23:35:07.919258+0000","last_became_peered":"2024-04-15T23:35:07.919258+0000","last_unstale":"2024-04-15T23:35:07.919572+0000","last_undegraded":"2024-04-15T23:35:07.919572+0000","last_fullsized":"2024-04-15T23:35:07.919572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:56.248931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291164+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:35:10.291164+0000","last_peered":"2024-04-15T23:35:10.291164+0000","last_clean":"2024-04-15T23:35:10.291164+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:35:10.291164+0000","last_undegraded":"2024-04-15T23:35:10.291164+0000","last_fullsized":"2024-04-15T23:35:10.291164+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":252,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905290+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:35:07.905290+0000","last_peered":"2024-04-15T23:35:07.905290+0000","last_clean":"2024-04-15T23:35:07.905290+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:35:07.905290+0000","last_undegraded":"2024-04-15T23:35:07.905290+0000","last_fullsized":"2024-04-15T23:35:07.905290+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900593+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:35:07.900593+0000","last_peered":"2024-04-15T23:35:07.900593+0000","last_clean":"2024-04-15T23:35:07.900593+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:35:07.900593+0000","last_undegraded":"2024-04-15T23:35:07.900593+0000","last_fullsized":"2024-04-15T23:35:07.900593+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290801+0000","last_change":"2024-04-15T23:35:07.935306+0000","last_active":"2024-04-15T23:35:10.290801+0000","last_peered":"2024-04-15T23:35:10.290801+0000","last_clean":"2024-04-15T23:35:10.290801+0000","last_became_active":"2024-04-15T23:35:07.919625+0000","last_became_peered":"2024-04-15T23:35:07.919625+0000","last_unstale":"2024-04-15T23:35:10.290801+0000","last_undegraded":"2024-04-15T23:35:10.290801+0000","last_fullsized":"2024-04-15T23:35:10.290801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:49:44.043170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":260,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.902230+0000","last_change":"2024-04-15T23:35:07.904291+0000","last_active":"2024-04-15T23:35:06.902230+0000","last_peered":"2024-04-15T23:35:06.094150+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:32:11.543852+0000","last_became_peered":"2024-04-15T23:32:11.543852+0000","last_unstale":"2024-04-15T23:35:06.902230+0000","last_undegraded":"2024-04-15T23:35:06.902230+0000","last_fullsized":"2024-04-15T23:35:06.902230+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291307+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:35:10.291307+0000","last_peered":"2024-04-15T23:35:10.291307+0000","last_clean":"2024-04-15T23:35:10.291307+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:35:10.291307+0000","last_undegraded":"2024-04-15T23:35:10.291307+0000","last_fullsized":"2024-04-15T23:35:10.291307+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":159,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902608+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:35:07.902608+0000","last_peered":"2024-04-15T23:35:07.902608+0000","last_clean":"2024-04-15T23:35:07.902608+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:35:07.902608+0000","last_undegraded":"2024-04-15T23:35:07.902608+0000","last_fullsized":"2024-04-15T23:35:07.902608+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":238,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093486+0000","last_change":"2024-04-15T23:35:07.904347+0000","last_active":"2024-04-15T23:35:07.904347+0000","last_peered":"2024-04-15T23:35:06.093486+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543464+0000","last_became_peered":"2024-04-15T23:32:11.543464+0000","last_unstale":"2024-04-15T23:35:06.093486+0000","last_undegraded":"2024-04-15T23:33:01.579673+0000","last_fullsized":"2024-04-15T23:32:11.540108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919852+0000","last_change":"2024-04-15T23:35:07.919852+0000","last_active":"2024-04-15T23:35:07.919852+0000","last_peered":"2024-04-15T23:35:07.919852+0000","last_clean":"2024-04-15T23:35:07.919852+0000","last_became_active":"2024-04-15T23:35:07.919642+0000","last_became_peered":"2024-04-15T23:35:07.919642+0000","last_unstale":"2024-04-15T23:35:07.919852+0000","last_undegraded":"2024-04-15T23:35:07.919852+0000","last_fullsized":"2024-04-15T23:35:07.919852+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:29.682287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923775+0000","last_change":"2024-04-15T23:35:07.923775+0000","last_active":"2024-04-15T23:35:07.923775+0000","last_peered":"2024-04-15T23:35:07.923775+0000","last_clean":"2024-04-15T23:35:07.923775+0000","last_became_active":"2024-04-15T23:35:07.923310+0000","last_became_peered":"2024-04-15T23:35:07.923310+0000","last_unstale":"2024-04-15T23:35:07.923775+0000","last_undegraded":"2024-04-15T23:35:07.923775+0000","last_fullsized":"2024-04-15T23:35:07.923775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:44.456832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":231,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092917+0000","last_change":"2024-04-15T23:35:07.901562+0000","last_active":"2024-04-15T23:35:07.901562+0000","last_peered":"2024-04-15T23:35:06.092917+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542992+0000","last_became_peered":"2024-04-15T23:32:11.542992+0000","last_unstale":"2024-04-15T23:35:06.092917+0000","last_undegraded":"2024-04-15T23:33:04.175963+0000","last_fullsized":"2024-04-15T23:32:11.540105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919638+0000","last_change":"2024-04-15T23:35:07.919638+0000","last_active":"2024-04-15T23:35:07.919638+0000","last_peered":"2024-04-15T23:35:07.919638+0000","last_clean":"2024-04-15T23:35:07.919638+0000","last_became_active":"2024-04-15T23:35:07.919325+0000","last_became_peered":"2024-04-15T23:35:07.919325+0000","last_unstale":"2024-04-15T23:35:07.919638+0000","last_undegraded":"2024-04-15T23:35:07.919638+0000","last_fullsized":"2024-04-15T23:35:07.919638+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:20.779700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291371+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:35:10.291371+0000","last_peered":"2024-04-15T23:35:10.291371+0000","last_clean":"2024-04-15T23:35:10.291371+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:35:10.291371+0000","last_undegraded":"2024-04-15T23:35:10.291371+0000","last_fullsized":"2024-04-15T23:35:10.291371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":312,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901889+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:35:07.901889+0000","last_peered":"2024-04-15T23:35:07.901889+0000","last_clean":"2024-04-15T23:35:07.901889+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:35:07.901889+0000","last_undegraded":"2024-04-15T23:35:07.901889+0000","last_fullsized":"2024-04-15T23:35:07.901889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291509+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:35:10.291509+0000","last_peered":"2024-04-15T23:35:10.291509+0000","last_clean":"2024-04-15T23:35:10.291509+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:35:10.291509+0000","last_undegraded":"2024-04-15T23:35:10.291509+0000","last_fullsized":"2024-04-15T23:35:10.291509+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.906853+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:35:07.906853+0000","last_peered":"2024-04-15T23:35:07.906853+0000","last_clean":"2024-04-15T23:35:07.906853+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:35:07.906853+0000","last_undegraded":"2024-04-15T23:35:07.906853+0000","last_fullsized":"2024-04-15T23:35:07.906853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":281,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902039+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:35:07.902039+0000","last_peered":"2024-04-15T23:35:07.902039+0000","last_clean":"2024-04-15T23:35:07.902039+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:35:07.902039+0000","last_undegraded":"2024-04-15T23:35:07.902039+0000","last_fullsized":"2024-04-15T23:35:07.902039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292195+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:35:10.292195+0000","last_peered":"2024-04-15T23:35:10.292195+0000","last_clean":"2024-04-15T23:35:10.292195+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:35:10.292195+0000","last_undegraded":"2024-04-15T23:35:10.292195+0000","last_fullsized":"2024-04-15T23:35:10.292195+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291681+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:35:10.291681+0000","last_peered":"2024-04-15T23:35:10.291681+0000","last_clean":"2024-04-15T23:35:10.291681+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:35:10.291681+0000","last_undegraded":"2024-04-15T23:35:10.291681+0000","last_fullsized":"2024-04-15T23:35:10.291681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":229,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.895269+0000","last_change":"2024-04-15T23:35:07.899081+0000","last_active":"2024-04-15T23:35:07.899081+0000","last_peered":"2024-04-15T23:35:05.895269+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544726+0000","last_became_peered":"2024-04-15T23:32:11.544726+0000","last_unstale":"2024-04-15T23:35:05.895269+0000","last_undegraded":"2024-04-15T23:33:01.573690+0000","last_fullsized":"2024-04-15T23:32:11.542306+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291688+0000","last_change":"2024-04-15T23:35:07.961077+0000","last_active":"2024-04-15T23:35:10.291688+0000","last_peered":"2024-04-15T23:35:10.291688+0000","last_clean":"2024-04-15T23:35:10.291688+0000","last_became_active":"2024-04-15T23:35:07.924404+0000","last_became_peered":"2024-04-15T23:35:07.924404+0000","last_unstale":"2024-04-15T23:35:10.291688+0000","last_undegraded":"2024-04-15T23:35:10.291688+0000","last_fullsized":"2024-04-15T23:35:10.291688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:26.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901672+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:35:07.901672+0000","last_peered":"2024-04-15T23:35:07.901672+0000","last_clean":"2024-04-15T23:35:07.901672+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:35:07.901672+0000","last_undegraded":"2024-04-15T23:35:07.901672+0000","last_fullsized":"2024-04-15T23:35:07.901672+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":243,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902940+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:35:07.902940+0000","last_peered":"2024-04-15T23:35:07.902940+0000","last_clean":"2024-04-15T23:35:07.902940+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:35:07.902940+0000","last_undegraded":"2024-04-15T23:35:07.902940+0000","last_fullsized":"2024-04-15T23:35:07.902940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":256,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.916138+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:35:07.916138+0000","last_peered":"2024-04-15T23:35:07.916138+0000","last_clean":"2024-04-15T23:35:07.916138+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:35:07.916138+0000","last_undegraded":"2024-04-15T23:35:07.916138+0000","last_fullsized":"2024-04-15T23:35:07.916138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":146,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.916498+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:35:07.916498+0000","last_peered":"2024-04-15T23:35:07.916498+0000","last_clean":"2024-04-15T23:35:07.916498+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:35:07.916498+0000","last_undegraded":"2024-04-15T23:35:07.916498+0000","last_fullsized":"2024-04-15T23:35:07.916498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":221,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092804+0000","last_change":"2024-04-15T23:35:07.901573+0000","last_active":"2024-04-15T23:35:07.901573+0000","last_peered":"2024-04-15T23:35:06.092804+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542068+0000","last_became_peered":"2024-04-15T23:32:11.542068+0000","last_unstale":"2024-04-15T23:35:06.092804+0000","last_undegraded":"2024-04-15T23:33:04.225125+0000","last_fullsized":"2024-04-15T23:32:11.539597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":126,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905532+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:35:07.905532+0000","last_peered":"2024-04-15T23:35:07.905532+0000","last_clean":"2024-04-15T23:35:07.905532+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:35:07.905532+0000","last_undegraded":"2024-04-15T23:35:07.905532+0000","last_fullsized":"2024-04-15T23:35:07.905532+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923603+0000","last_change":"2024-04-15T23:35:07.923603+0000","last_active":"2024-04-15T23:35:07.923603+0000","last_peered":"2024-04-15T23:35:07.923603+0000","last_clean":"2024-04-15T23:35:07.923603+0000","last_became_active":"2024-04-15T23:35:07.923069+0000","last_became_peered":"2024-04-15T23:35:07.923069+0000","last_unstale":"2024-04-15T23:35:07.923603+0000","last_undegraded":"2024-04-15T23:35:07.923603+0000","last_fullsized":"2024-04-15T23:35:07.923603+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:39.536190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":257,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.295722+0000","last_change":"2024-04-15T23:35:10.295722+0000","last_active":"2024-04-15T23:35:10.295722+0000","last_peered":"2024-04-15T23:35:10.295722+0000","last_clean":"2024-04-15T23:35:10.295722+0000","last_became_active":"2024-04-15T23:35:10.294673+0000","last_became_peered":"2024-04-15T23:35:10.294673+0000","last_unstale":"2024-04-15T23:35:10.295722+0000","last_undegraded":"2024-04-15T23:35:10.295722+0000","last_fullsized":"2024-04-15T23:35:10.295722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:19.610009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292274+0000","last_change":"2024-04-15T23:35:07.923646+0000","last_active":"2024-04-15T23:35:10.292274+0000","last_peered":"2024-04-15T23:35:10.292274+0000","last_clean":"2024-04-15T23:35:10.292274+0000","last_became_active":"2024-04-15T23:35:07.923298+0000","last_became_peered":"2024-04-15T23:35:07.923298+0000","last_unstale":"2024-04-15T23:35:10.292274+0000","last_undegraded":"2024-04-15T23:35:10.292274+0000","last_fullsized":"2024-04-15T23:35:10.292274+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:01.524255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.302738+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:35:10.302738+0000","last_peered":"2024-04-15T23:35:10.302738+0000","last_clean":"2024-04-15T23:35:10.302738+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:35:10.302738+0000","last_undegraded":"2024-04-15T23:35:10.302738+0000","last_fullsized":"2024-04-15T23:35:10.302738+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":272,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905550+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:35:07.905550+0000","last_peered":"2024-04-15T23:35:07.905550+0000","last_clean":"2024-04-15T23:35:07.905550+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:35:07.905550+0000","last_undegraded":"2024-04-15T23:35:07.905550+0000","last_fullsized":"2024-04-15T23:35:07.905550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290687+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:35:10.290687+0000","last_peered":"2024-04-15T23:35:10.290687+0000","last_clean":"2024-04-15T23:35:10.290687+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:35:10.290687+0000","last_undegraded":"2024-04-15T23:35:10.290687+0000","last_fullsized":"2024-04-15T23:35:10.290687+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":231,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.897081+0000","last_change":"2024-04-15T23:35:07.901641+0000","last_active":"2024-04-15T23:35:07.901641+0000","last_peered":"2024-04-15T23:35:05.897081+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:35:05.897081+0000","last_undegraded":"2024-04-15T23:33:04.164120+0000","last_fullsized":"2024-04-15T23:32:11.544284+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290735+0000","last_change":"2024-04-15T23:35:07.917897+0000","last_active":"2024-04-15T23:35:10.290735+0000","last_peered":"2024-04-15T23:35:10.290735+0000","last_clean":"2024-04-15T23:35:10.290735+0000","last_became_active":"2024-04-15T23:35:07.917508+0000","last_became_peered":"2024-04-15T23:35:07.917508+0000","last_unstale":"2024-04-15T23:35:10.290735+0000","last_undegraded":"2024-04-15T23:35:10.290735+0000","last_fullsized":"2024-04-15T23:35:10.290735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:41:58.784211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":249,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903307+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:35:07.903307+0000","last_peered":"2024-04-15T23:35:07.903307+0000","last_clean":"2024-04-15T23:35:07.903307+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:35:07.903307+0000","last_undegraded":"2024-04-15T23:35:07.903307+0000","last_fullsized":"2024-04-15T23:35:07.903307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":117,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.932913+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:35:07.932913+0000","last_peered":"2024-04-15T23:35:07.932913+0000","last_clean":"2024-04-15T23:35:07.932913+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:35:07.932913+0000","last_undegraded":"2024-04-15T23:35:07.932913+0000","last_fullsized":"2024-04-15T23:35:07.932913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":261,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900548+0000","last_change":"2024-04-15T23:35:07.903100+0000","last_active":"2024-04-15T23:35:06.900548+0000","last_peered":"2024-04-15T23:35:06.093544+0000","last_clean":"2024-04-15T23:32:07.533902+0000","last_became_active":"2024-04-15T23:32:11.543802+0000","last_became_peered":"2024-04-15T23:32:11.543802+0000","last_unstale":"2024-04-15T23:35:06.900548+0000","last_undegraded":"2024-04-15T23:35:06.900548+0000","last_fullsized":"2024-04-15T23:35:06.900548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":108,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903048+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:35:07.903048+0000","last_peered":"2024-04-15T23:35:07.903048+0000","last_clean":"2024-04-15T23:35:07.903048+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:35:07.903048+0000","last_undegraded":"2024-04-15T23:35:07.903048+0000","last_fullsized":"2024-04-15T23:35:07.903048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":264,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.904708+0000","last_change":"2024-04-15T23:35:07.901803+0000","last_active":"2024-04-15T23:35:06.904708+0000","last_peered":"2024-04-15T23:35:05.895982+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:32:11.545464+0000","last_became_peered":"2024-04-15T23:32:11.545464+0000","last_unstale":"2024-04-15T23:35:06.904708+0000","last_undegraded":"2024-04-15T23:35:06.904708+0000","last_fullsized":"2024-04-15T23:35:06.904708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":112,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923605+0000","last_change":"2024-04-15T23:35:07.923605+0000","last_active":"2024-04-15T23:35:07.923605+0000","last_peered":"2024-04-15T23:35:07.923605+0000","last_clean":"2024-04-15T23:35:07.923605+0000","last_became_active":"2024-04-15T23:35:07.923048+0000","last_became_peered":"2024-04-15T23:35:07.923048+0000","last_unstale":"2024-04-15T23:35:07.923605+0000","last_undegraded":"2024-04-15T23:35:07.923605+0000","last_fullsized":"2024-04-15T23:35:07.923605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:24.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":260,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.906284+0000","last_change":"2024-04-15T23:35:07.916055+0000","last_active":"2024-04-15T23:35:06.906284+0000","last_peered":"2024-04-15T23:35:05.896380+0000","last_clean":"2024-04-15T23:32:07.786529+0000","last_became_active":"2024-04-15T23:32:11.547235+0000","last_became_peered":"2024-04-15T23:32:11.547235+0000","last_unstale":"2024-04-15T23:35:06.906284+0000","last_undegraded":"2024-04-15T23:35:06.906284+0000","last_fullsized":"2024-04-15T23:35:06.906284+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":162,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.904796+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:35:07.904796+0000","last_peered":"2024-04-15T23:35:07.904796+0000","last_clean":"2024-04-15T23:35:07.904796+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:35:07.904796+0000","last_undegraded":"2024-04-15T23:35:07.904796+0000","last_fullsized":"2024-04-15T23:35:07.904796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":268,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.901530+0000","last_change":"2024-04-15T23:35:07.904557+0000","last_active":"2024-04-15T23:35:06.901530+0000","last_peered":"2024-04-15T23:35:06.093717+0000","last_clean":"2024-04-15T23:32:07.533827+0000","last_became_active":"2024-04-15T23:32:11.543217+0000","last_became_peered":"2024-04-15T23:32:11.543217+0000","last_unstale":"2024-04-15T23:35:06.901530+0000","last_undegraded":"2024-04-15T23:35:06.901530+0000","last_fullsized":"2024-04-15T23:35:06.901530+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292005+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:35:10.292005+0000","last_peered":"2024-04-15T23:35:10.292005+0000","last_clean":"2024-04-15T23:35:10.292005+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:35:10.292005+0000","last_undegraded":"2024-04-15T23:35:10.292005+0000","last_fullsized":"2024-04-15T23:35:10.292005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":290,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.901135+0000","last_change":"2024-04-15T23:35:07.901208+0000","last_active":"2024-04-15T23:35:06.901135+0000","last_peered":"2024-04-15T23:35:05.895938+0000","last_clean":"2024-04-15T23:32:07.786282+0000","last_became_active":"2024-04-15T23:32:11.548138+0000","last_became_peered":"2024-04-15T23:32:11.548138+0000","last_unstale":"2024-04-15T23:35:06.901135+0000","last_undegraded":"2024-04-15T23:35:06.901135+0000","last_fullsized":"2024-04-15T23:35:06.901135+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292065+0000","last_change":"2024-04-15T23:35:07.956652+0000","last_active":"2024-04-15T23:35:10.292065+0000","last_peered":"2024-04-15T23:35:10.292065+0000","last_clean":"2024-04-15T23:35:10.292065+0000","last_became_active":"2024-04-15T23:35:07.923145+0000","last_became_peered":"2024-04-15T23:35:07.923145+0000","last_unstale":"2024-04-15T23:35:10.292065+0000","last_undegraded":"2024-04-15T23:35:10.292065+0000","last_fullsized":"2024-04-15T23:35:10.292065+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:50:11.946892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":435,"num_bytes_recovered":433886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53833728,"data_stored":38400819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":63,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103170,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54736,"kb_used_data":23040,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94317104,"statfs":{"total":96636764160,"available":96580714496,"internally_reserved":0,"allocated":23592960,"data_stored":22021809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":32433383},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83760,"kb_used_data":52580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94288080,"statfs":{"total":96636764160,"available":96550993920,"internally_reserved":0,"allocated":53841920,"data_stored":46983214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738415,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88740,"kb_used_data":57560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283100,"statfs":{"total":96636764160,"available":96545894400,"internally_reserved":0,"allocated":58941440,"data_stored":52086637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19513344,"data_stored":12945571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5849088,"data_stored":3559202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:35:13.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:35:13.938 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:13.940 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:35:13.949 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-04-15T23:35:13.827453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":441,"num_bytes_recovered":17538746,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":227236,"kb_used_data":133180,"kb_used_omap":9,"kb_used_meta":94006,"kb_avail":282888284,"statfs":{"total":289910292480,"available":289677602816,"internally_reserved":0,"allocated":136376320,"data_stored":121091660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":96262257},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":440,"num_bytes_recovered":13344442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.915510"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":253,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.903354+0000","last_change":"2024-04-15T23:35:07.905709+0000","last_active":"2024-04-15T23:35:06.903354+0000","last_peered":"2024-04-15T23:35:06.094422+0000","last_clean":"2024-04-15T23:32:07.534338+0000","last_became_active":"2024-04-15T23:32:11.544352+0000","last_became_peered":"2024-04-15T23:32:11.544352+0000","last_unstale":"2024-04-15T23:35:06.903354+0000","last_undegraded":"2024-04-15T23:35:06.903354+0000","last_fullsized":"2024-04-15T23:35:06.903354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":251,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900000+0000","last_change":"2024-04-15T23:35:07.903037+0000","last_active":"2024-04-15T23:35:06.900000+0000","last_peered":"2024-04-15T23:35:06.093690+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:32:11.543124+0000","last_became_peered":"2024-04-15T23:32:11.543124+0000","last_unstale":"2024-04-15T23:35:06.900000+0000","last_undegraded":"2024-04-15T23:35:06.900000+0000","last_fullsized":"2024-04-15T23:35:06.900000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":270,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900211+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:35:07.900211+0000","last_peered":"2024-04-15T23:35:07.900211+0000","last_clean":"2024-04-15T23:35:07.900211+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:35:07.900211+0000","last_undegraded":"2024-04-15T23:35:07.900211+0000","last_fullsized":"2024-04-15T23:35:07.900211+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":229,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.905148+0000","last_change":"2024-04-15T23:35:07.900511+0000","last_active":"2024-04-15T23:35:06.905148+0000","last_peered":"2024-04-15T23:35:05.896012+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:32:11.545419+0000","last_became_peered":"2024-04-15T23:32:11.545419+0000","last_unstale":"2024-04-15T23:35:06.905148+0000","last_undegraded":"2024-04-15T23:35:06.905148+0000","last_fullsized":"2024-04-15T23:35:06.905148+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":274,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.898909+0000","last_change":"2024-04-15T23:35:07.902966+0000","last_active":"2024-04-15T23:35:06.898909+0000","last_peered":"2024-04-15T23:35:06.093434+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:32:11.543474+0000","last_became_peered":"2024-04-15T23:32:11.543474+0000","last_unstale":"2024-04-15T23:35:06.898909+0000","last_undegraded":"2024-04-15T23:35:06.898909+0000","last_fullsized":"2024-04-15T23:35:06.898909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":274,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.903072+0000","last_change":"2024-04-15T23:35:07.899621+0000","last_active":"2024-04-15T23:35:06.903072+0000","last_peered":"2024-04-15T23:35:05.895581+0000","last_clean":"2024-04-15T23:32:07.786325+0000","last_became_active":"2024-04-15T23:32:11.545668+0000","last_became_peered":"2024-04-15T23:32:11.545668+0000","last_unstale":"2024-04-15T23:35:06.903072+0000","last_undegraded":"2024-04-15T23:35:06.903072+0000","last_fullsized":"2024-04-15T23:35:06.903072+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":267,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.905135+0000","last_change":"2024-04-15T23:35:07.905804+0000","last_active":"2024-04-15T23:35:06.905135+0000","last_peered":"2024-04-15T23:35:05.896424+0000","last_clean":"2024-04-15T23:32:07.786350+0000","last_became_active":"2024-04-15T23:32:11.546347+0000","last_became_peered":"2024-04-15T23:32:11.546347+0000","last_unstale":"2024-04-15T23:35:06.905135+0000","last_undegraded":"2024-04-15T23:35:06.905135+0000","last_fullsized":"2024-04-15T23:35:06.905135+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":244,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.904255+0000","last_change":"2024-04-15T23:35:07.899337+0000","last_active":"2024-04-15T23:35:06.904255+0000","last_peered":"2024-04-15T23:35:05.895492+0000","last_clean":"2024-04-15T23:32:07.786081+0000","last_became_active":"2024-04-15T23:32:11.545203+0000","last_became_peered":"2024-04-15T23:32:11.545203+0000","last_unstale":"2024-04-15T23:35:06.904255+0000","last_undegraded":"2024-04-15T23:35:06.904255+0000","last_fullsized":"2024-04-15T23:35:06.904255+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":241,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.094642+0000","last_change":"2024-04-15T23:35:07.906227+0000","last_active":"2024-04-15T23:35:07.906227+0000","last_peered":"2024-04-15T23:35:06.094642+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545953+0000","last_became_peered":"2024-04-15T23:32:11.545953+0000","last_unstale":"2024-04-15T23:35:06.094642+0000","last_undegraded":"2024-04-15T23:33:04.251389+0000","last_fullsized":"2024-04-15T23:32:11.541547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":253,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900167+0000","last_change":"2024-04-15T23:35:07.904521+0000","last_active":"2024-04-15T23:35:06.900167+0000","last_peered":"2024-04-15T23:35:06.094129+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:32:11.543541+0000","last_became_peered":"2024-04-15T23:32:11.543541+0000","last_unstale":"2024-04-15T23:35:06.900167+0000","last_undegraded":"2024-04-15T23:35:06.900167+0000","last_fullsized":"2024-04-15T23:35:06.900167+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":252,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.902952+0000","last_change":"2024-04-15T23:35:07.901674+0000","last_active":"2024-04-15T23:35:06.902952+0000","last_peered":"2024-04-15T23:35:05.896861+0000","last_clean":"2024-04-15T23:32:07.786647+0000","last_became_active":"2024-04-15T23:32:11.545422+0000","last_became_peered":"2024-04-15T23:32:11.545422+0000","last_unstale":"2024-04-15T23:35:06.902952+0000","last_undegraded":"2024-04-15T23:35:06.902952+0000","last_fullsized":"2024-04-15T23:35:06.902952+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":242,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902178+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:35:07.902178+0000","last_peered":"2024-04-15T23:35:07.902178+0000","last_clean":"2024-04-15T23:35:07.902178+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:35:07.902178+0000","last_undegraded":"2024-04-15T23:35:07.902178+0000","last_fullsized":"2024-04-15T23:35:07.902178+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":236,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.897574+0000","last_change":"2024-04-15T23:35:07.902161+0000","last_active":"2024-04-15T23:35:06.897574+0000","last_peered":"2024-04-15T23:35:06.093005+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:32:11.543005+0000","last_became_peered":"2024-04-15T23:32:11.543005+0000","last_unstale":"2024-04-15T23:35:06.897574+0000","last_undegraded":"2024-04-15T23:35:06.897574+0000","last_fullsized":"2024-04-15T23:35:06.897574+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":278,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.899042+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:35:07.899042+0000","last_peered":"2024-04-15T23:35:07.899042+0000","last_clean":"2024-04-15T23:35:07.899042+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:35:07.899042+0000","last_undegraded":"2024-04-15T23:35:07.899042+0000","last_fullsized":"2024-04-15T23:35:07.899042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":258,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900937+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:35:07.900937+0000","last_peered":"2024-04-15T23:35:07.900937+0000","last_clean":"2024-04-15T23:35:07.900937+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:35:07.900937+0000","last_undegraded":"2024-04-15T23:35:07.900937+0000","last_fullsized":"2024-04-15T23:35:07.900937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":278,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.905190+0000","last_change":"2024-04-15T23:35:07.899944+0000","last_active":"2024-04-15T23:35:06.905190+0000","last_peered":"2024-04-15T23:35:05.895520+0000","last_clean":"2024-04-15T23:32:07.786096+0000","last_became_active":"2024-04-15T23:32:11.546233+0000","last_became_peered":"2024-04-15T23:32:11.546233+0000","last_unstale":"2024-04-15T23:35:06.905190+0000","last_undegraded":"2024-04-15T23:35:06.905190+0000","last_fullsized":"2024-04-15T23:35:06.905190+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":239,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093791+0000","last_change":"2024-04-15T23:35:07.904671+0000","last_active":"2024-04-15T23:35:07.904671+0000","last_peered":"2024-04-15T23:35:06.093791+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543951+0000","last_became_peered":"2024-04-15T23:32:11.543951+0000","last_unstale":"2024-04-15T23:35:06.093791+0000","last_undegraded":"2024-04-15T23:33:04.222718+0000","last_fullsized":"2024-04-15T23:32:11.540820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":251,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.903258+0000","last_change":"2024-04-15T23:35:07.905647+0000","last_active":"2024-04-15T23:35:06.903258+0000","last_peered":"2024-04-15T23:35:06.094353+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:32:11.546238+0000","last_became_peered":"2024-04-15T23:32:11.546238+0000","last_unstale":"2024-04-15T23:35:06.903258+0000","last_undegraded":"2024-04-15T23:35:06.903258+0000","last_fullsized":"2024-04-15T23:35:06.903258+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":218,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093128+0000","last_change":"2024-04-15T23:35:07.902727+0000","last_active":"2024-04-15T23:35:07.902727+0000","last_peered":"2024-04-15T23:35:06.093128+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:35:06.093128+0000","last_undegraded":"2024-04-15T23:33:04.197729+0000","last_fullsized":"2024-04-15T23:32:11.541074+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":299,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.904800+0000","last_change":"2024-04-15T23:35:07.901046+0000","last_active":"2024-04-15T23:35:06.904800+0000","last_peered":"2024-04-15T23:35:05.896676+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:32:11.546261+0000","last_became_peered":"2024-04-15T23:32:11.546261+0000","last_unstale":"2024-04-15T23:35:06.904800+0000","last_undegraded":"2024-04-15T23:35:06.904800+0000","last_fullsized":"2024-04-15T23:35:06.904800+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":263,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.907295+0000","last_change":"2024-04-15T23:35:07.916950+0000","last_active":"2024-04-15T23:35:06.907295+0000","last_peered":"2024-04-15T23:35:05.896434+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:32:11.545687+0000","last_became_peered":"2024-04-15T23:32:11.545687+0000","last_unstale":"2024-04-15T23:35:06.907295+0000","last_undegraded":"2024-04-15T23:35:06.907295+0000","last_fullsized":"2024-04-15T23:35:06.907295+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":271,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901741+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:35:07.901741+0000","last_peered":"2024-04-15T23:35:07.901741+0000","last_clean":"2024-04-15T23:35:07.901741+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:35:07.901741+0000","last_undegraded":"2024-04-15T23:35:07.901741+0000","last_fullsized":"2024-04-15T23:35:07.901741+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.294643+0000","last_change":"2024-04-15T23:35:10.294643+0000","last_active":"2024-04-15T23:35:10.294643+0000","last_peered":"2024-04-15T23:35:10.294643+0000","last_clean":"2024-04-15T23:35:10.294643+0000","last_became_active":"2024-04-15T23:35:10.293497+0000","last_became_peered":"2024-04-15T23:35:10.293497+0000","last_unstale":"2024-04-15T23:35:10.294643+0000","last_undegraded":"2024-04-15T23:35:10.294643+0000","last_fullsized":"2024-04-15T23:35:10.294643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:12:59.503325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":266,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.897533+0000","last_change":"2024-04-15T23:35:07.901061+0000","last_active":"2024-04-15T23:35:06.897533+0000","last_peered":"2024-04-15T23:35:06.092556+0000","last_clean":"2024-04-15T23:32:07.533578+0000","last_became_active":"2024-04-15T23:32:11.541949+0000","last_became_peered":"2024-04-15T23:32:11.541949+0000","last_unstale":"2024-04-15T23:35:06.897533+0000","last_undegraded":"2024-04-15T23:35:06.897533+0000","last_fullsized":"2024-04-15T23:35:06.897533+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":257,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.904888+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:35:07.904888+0000","last_peered":"2024-04-15T23:35:07.904888+0000","last_clean":"2024-04-15T23:35:07.904888+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:35:07.904888+0000","last_undegraded":"2024-04-15T23:35:07.904888+0000","last_fullsized":"2024-04-15T23:35:07.904888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":264,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.897597+0000","last_change":"2024-04-15T23:35:07.916714+0000","last_active":"2024-04-15T23:35:07.916714+0000","last_peered":"2024-04-15T23:35:05.897597+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:35:05.897597+0000","last_undegraded":"2024-04-15T23:33:01.567164+0000","last_fullsized":"2024-04-15T23:32:11.544630+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":261,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900823+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:35:07.900823+0000","last_peered":"2024-04-15T23:35:07.900823+0000","last_clean":"2024-04-15T23:35:07.900823+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:35:07.900823+0000","last_undegraded":"2024-04-15T23:35:07.900823+0000","last_fullsized":"2024-04-15T23:35:07.900823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":252,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903539+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:35:07.903539+0000","last_peered":"2024-04-15T23:35:07.903539+0000","last_clean":"2024-04-15T23:35:07.903539+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:35:07.903539+0000","last_undegraded":"2024-04-15T23:35:07.903539+0000","last_fullsized":"2024-04-15T23:35:07.903539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":241,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092822+0000","last_change":"2024-04-15T23:35:07.901559+0000","last_active":"2024-04-15T23:35:07.901559+0000","last_peered":"2024-04-15T23:35:06.092822+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.541839+0000","last_became_peered":"2024-04-15T23:32:11.541839+0000","last_unstale":"2024-04-15T23:35:06.092822+0000","last_undegraded":"2024-04-15T23:33:03.941073+0000","last_fullsized":"2024-04-15T23:32:11.539929+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":294,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902056+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:35:07.902056+0000","last_peered":"2024-04-15T23:35:07.902056+0000","last_clean":"2024-04-15T23:35:07.902056+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:35:07.902056+0000","last_undegraded":"2024-04-15T23:35:07.902056+0000","last_fullsized":"2024-04-15T23:35:07.902056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":271,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.299527+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:35:10.299527+0000","last_peered":"2024-04-15T23:35:10.299527+0000","last_clean":"2024-04-15T23:35:10.299527+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:35:10.299527+0000","last_undegraded":"2024-04-15T23:35:10.299527+0000","last_fullsized":"2024-04-15T23:35:10.299527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":282,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900728+0000","last_change":"2024-04-15T23:35:07.900222+0000","last_active":"2024-04-15T23:35:06.900728+0000","last_peered":"2024-04-15T23:35:05.895712+0000","last_clean":"2024-04-15T23:32:07.786183+0000","last_became_active":"2024-04-15T23:32:11.545613+0000","last_became_peered":"2024-04-15T23:32:11.545613+0000","last_unstale":"2024-04-15T23:35:06.900728+0000","last_undegraded":"2024-04-15T23:35:06.900728+0000","last_fullsized":"2024-04-15T23:35:06.900728+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":254,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.901126+0000","last_change":"2024-04-15T23:35:07.904154+0000","last_active":"2024-04-15T23:35:06.901126+0000","last_peered":"2024-04-15T23:35:06.094119+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:32:11.543993+0000","last_became_peered":"2024-04-15T23:32:11.543993+0000","last_unstale":"2024-04-15T23:35:06.901126+0000","last_undegraded":"2024-04-15T23:35:06.901126+0000","last_fullsized":"2024-04-15T23:35:06.901126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":235,"reported_epoch":59,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:07.916920+0000","last_change":"2024-04-15T23:35:07.916920+0000","last_active":"2024-04-15T23:35:06.907266+0000","last_peered":"2024-04-15T23:35:05.896729+0000","last_clean":"2024-04-15T23:32:07.786667+0000","last_became_active":"2024-04-15T23:32:11.547544+0000","last_became_peered":"2024-04-15T23:32:11.547544+0000","last_unstale":"2024-04-15T23:35:07.916920+0000","last_undegraded":"2024-04-15T23:35:07.916920+0000","last_fullsized":"2024-04-15T23:35:07.916920+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":253,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900727+0000","last_change":"2024-04-15T23:35:07.901240+0000","last_active":"2024-04-15T23:35:06.900727+0000","last_peered":"2024-04-15T23:35:06.093786+0000","last_clean":"2024-04-15T23:32:07.534221+0000","last_became_active":"2024-04-15T23:32:11.543376+0000","last_became_peered":"2024-04-15T23:32:11.543376+0000","last_unstale":"2024-04-15T23:35:06.900727+0000","last_undegraded":"2024-04-15T23:35:06.900727+0000","last_fullsized":"2024-04-15T23:35:06.900727+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290951+0000","last_change":"2024-04-15T23:35:07.923327+0000","last_active":"2024-04-15T23:35:10.290951+0000","last_peered":"2024-04-15T23:35:10.290951+0000","last_clean":"2024-04-15T23:35:10.290951+0000","last_became_active":"2024-04-15T23:35:07.923022+0000","last_became_peered":"2024-04-15T23:35:07.923022+0000","last_unstale":"2024-04-15T23:35:10.290951+0000","last_undegraded":"2024-04-15T23:35:10.290951+0000","last_fullsized":"2024-04-15T23:35:10.290951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:56.197588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":266,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.896869+0000","last_change":"2024-04-15T23:35:07.901247+0000","last_active":"2024-04-15T23:35:07.901247+0000","last_peered":"2024-04-15T23:35:05.896869+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546377+0000","last_became_peered":"2024-04-15T23:32:11.546377+0000","last_unstale":"2024-04-15T23:35:05.896869+0000","last_undegraded":"2024-04-15T23:33:04.211090+0000","last_fullsized":"2024-04-15T23:32:11.543483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903065+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:35:07.903065+0000","last_peered":"2024-04-15T23:35:07.903065+0000","last_clean":"2024-04-15T23:35:07.903065+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:35:07.903065+0000","last_undegraded":"2024-04-15T23:35:07.903065+0000","last_fullsized":"2024-04-15T23:35:07.903065+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":252,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.896657+0000","last_change":"2024-04-15T23:35:07.900977+0000","last_active":"2024-04-15T23:35:07.900977+0000","last_peered":"2024-04-15T23:35:05.896657+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547018+0000","last_became_peered":"2024-04-15T23:32:11.547018+0000","last_unstale":"2024-04-15T23:35:05.896657+0000","last_undegraded":"2024-04-15T23:33:04.171797+0000","last_fullsized":"2024-04-15T23:32:11.543473+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":112,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900150+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:35:07.900150+0000","last_peered":"2024-04-15T23:35:07.900150+0000","last_clean":"2024-04-15T23:35:07.900150+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:35:07.900150+0000","last_undegraded":"2024-04-15T23:35:07.900150+0000","last_fullsized":"2024-04-15T23:35:07.900150+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":104,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901535+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:35:07.901535+0000","last_peered":"2024-04-15T23:35:07.901535+0000","last_clean":"2024-04-15T23:35:07.901535+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:35:07.901535+0000","last_undegraded":"2024-04-15T23:35:07.901535+0000","last_fullsized":"2024-04-15T23:35:07.901535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":254,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902492+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:35:07.902492+0000","last_peered":"2024-04-15T23:35:07.902492+0000","last_clean":"2024-04-15T23:35:07.902492+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:35:07.902492+0000","last_undegraded":"2024-04-15T23:35:07.902492+0000","last_fullsized":"2024-04-15T23:35:07.902492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":106,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.904890+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:35:07.904890+0000","last_peered":"2024-04-15T23:35:07.904890+0000","last_clean":"2024-04-15T23:35:07.904890+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:35:07.904890+0000","last_undegraded":"2024-04-15T23:35:07.904890+0000","last_fullsized":"2024-04-15T23:35:07.904890+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":285,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.897659+0000","last_change":"2024-04-15T23:35:06.897659+0000","last_active":"2024-04-15T23:35:06.897659+0000","last_peered":"2024-04-15T23:35:06.092691+0000","last_clean":"2024-04-15T23:35:06.092691+0000","last_became_active":"2024-04-15T23:32:52.246717+0000","last_became_peered":"2024-04-15T23:32:52.246717+0000","last_unstale":"2024-04-15T23:35:06.897659+0000","last_undegraded":"2024-04-15T23:35:06.897659+0000","last_fullsized":"2024-04-15T23:35:06.897659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":104,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905385+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:35:07.905385+0000","last_peered":"2024-04-15T23:35:07.905385+0000","last_clean":"2024-04-15T23:35:07.905385+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:35:07.905385+0000","last_undegraded":"2024-04-15T23:35:07.905385+0000","last_fullsized":"2024-04-15T23:35:07.905385+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":248,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.906218+0000","last_change":"2024-04-15T23:35:07.900037+0000","last_active":"2024-04-15T23:35:06.906218+0000","last_peered":"2024-04-15T23:35:05.895990+0000","last_clean":"2024-04-15T23:32:07.786434+0000","last_became_active":"2024-04-15T23:32:11.547212+0000","last_became_peered":"2024-04-15T23:32:11.547212+0000","last_unstale":"2024-04-15T23:35:06.906218+0000","last_undegraded":"2024-04-15T23:35:06.906218+0000","last_fullsized":"2024-04-15T23:35:06.906218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923940+0000","last_change":"2024-04-15T23:35:07.923940+0000","last_active":"2024-04-15T23:35:07.923940+0000","last_peered":"2024-04-15T23:35:07.923940+0000","last_clean":"2024-04-15T23:35:07.923940+0000","last_became_active":"2024-04-15T23:35:07.923559+0000","last_became_peered":"2024-04-15T23:35:07.923559+0000","last_unstale":"2024-04-15T23:35:07.923940+0000","last_undegraded":"2024-04-15T23:35:07.923940+0000","last_fullsized":"2024-04-15T23:35:07.923940+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:34.992257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":230,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.895674+0000","last_change":"2024-04-15T23:35:07.901912+0000","last_active":"2024-04-15T23:35:07.901912+0000","last_peered":"2024-04-15T23:35:05.895674+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545235+0000","last_became_peered":"2024-04-15T23:32:11.545235+0000","last_unstale":"2024-04-15T23:35:05.895674+0000","last_undegraded":"2024-04-15T23:33:04.172129+0000","last_fullsized":"2024-04-15T23:32:11.542558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291162+0000","last_change":"2024-04-15T23:35:07.979404+0000","last_active":"2024-04-15T23:35:10.291162+0000","last_peered":"2024-04-15T23:35:10.291162+0000","last_clean":"2024-04-15T23:35:10.291162+0000","last_became_active":"2024-04-15T23:35:07.924742+0000","last_became_peered":"2024-04-15T23:35:07.924742+0000","last_unstale":"2024-04-15T23:35:10.291162+0000","last_undegraded":"2024-04-15T23:35:10.291162+0000","last_fullsized":"2024-04-15T23:35:10.291162+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:59.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":281,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.906545+0000","last_change":"2024-04-15T23:35:07.902310+0000","last_active":"2024-04-15T23:35:06.906545+0000","last_peered":"2024-04-15T23:35:05.896597+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:32:11.545650+0000","last_became_peered":"2024-04-15T23:32:11.545650+0000","last_unstale":"2024-04-15T23:35:06.906545+0000","last_undegraded":"2024-04-15T23:35:06.906545+0000","last_fullsized":"2024-04-15T23:35:06.906545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919642+0000","last_change":"2024-04-15T23:35:07.919642+0000","last_active":"2024-04-15T23:35:07.919642+0000","last_peered":"2024-04-15T23:35:07.919642+0000","last_clean":"2024-04-15T23:35:07.919642+0000","last_became_active":"2024-04-15T23:35:07.919354+0000","last_became_peered":"2024-04-15T23:35:07.919354+0000","last_unstale":"2024-04-15T23:35:07.919642+0000","last_undegraded":"2024-04-15T23:35:07.919642+0000","last_fullsized":"2024-04-15T23:35:07.919642+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:24.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":267,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901442+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:35:07.901442+0000","last_peered":"2024-04-15T23:35:07.901442+0000","last_clean":"2024-04-15T23:35:07.901442+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:35:07.901442+0000","last_undegraded":"2024-04-15T23:35:07.901442+0000","last_fullsized":"2024-04-15T23:35:07.901442+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":103,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903580+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:35:07.903580+0000","last_peered":"2024-04-15T23:35:07.903580+0000","last_clean":"2024-04-15T23:35:07.903580+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:35:07.903580+0000","last_undegraded":"2024-04-15T23:35:07.903580+0000","last_fullsized":"2024-04-15T23:35:07.903580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":239,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.916094+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:35:07.916094+0000","last_peered":"2024-04-15T23:35:07.916094+0000","last_clean":"2024-04-15T23:35:07.916094+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:35:07.916094+0000","last_undegraded":"2024-04-15T23:35:07.916094+0000","last_fullsized":"2024-04-15T23:35:07.916094+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":111,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.909057+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:35:07.909057+0000","last_peered":"2024-04-15T23:35:07.909057+0000","last_clean":"2024-04-15T23:35:07.909057+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:35:07.909057+0000","last_undegraded":"2024-04-15T23:35:07.909057+0000","last_fullsized":"2024-04-15T23:35:07.909057+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":219,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093956+0000","last_change":"2024-04-15T23:35:07.903520+0000","last_active":"2024-04-15T23:35:07.903520+0000","last_peered":"2024-04-15T23:35:06.093956+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543916+0000","last_became_peered":"2024-04-15T23:32:11.543916+0000","last_unstale":"2024-04-15T23:35:06.093956+0000","last_undegraded":"2024-04-15T23:33:04.173908+0000","last_fullsized":"2024-04-15T23:32:11.540434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":305,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900727+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:35:07.900727+0000","last_peered":"2024-04-15T23:35:07.900727+0000","last_clean":"2024-04-15T23:35:07.900727+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:35:07.900727+0000","last_undegraded":"2024-04-15T23:35:07.900727+0000","last_fullsized":"2024-04-15T23:35:07.900727+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919572+0000","last_change":"2024-04-15T23:35:07.919572+0000","last_active":"2024-04-15T23:35:07.919572+0000","last_peered":"2024-04-15T23:35:07.919572+0000","last_clean":"2024-04-15T23:35:07.919572+0000","last_became_active":"2024-04-15T23:35:07.919258+0000","last_became_peered":"2024-04-15T23:35:07.919258+0000","last_unstale":"2024-04-15T23:35:07.919572+0000","last_undegraded":"2024-04-15T23:35:07.919572+0000","last_fullsized":"2024-04-15T23:35:07.919572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:56.248931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291164+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:35:10.291164+0000","last_peered":"2024-04-15T23:35:10.291164+0000","last_clean":"2024-04-15T23:35:10.291164+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:35:10.291164+0000","last_undegraded":"2024-04-15T23:35:10.291164+0000","last_fullsized":"2024-04-15T23:35:10.291164+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":252,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905290+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:35:07.905290+0000","last_peered":"2024-04-15T23:35:07.905290+0000","last_clean":"2024-04-15T23:35:07.905290+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:35:07.905290+0000","last_undegraded":"2024-04-15T23:35:07.905290+0000","last_fullsized":"2024-04-15T23:35:07.905290+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.900593+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:35:07.900593+0000","last_peered":"2024-04-15T23:35:07.900593+0000","last_clean":"2024-04-15T23:35:07.900593+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:35:07.900593+0000","last_undegraded":"2024-04-15T23:35:07.900593+0000","last_fullsized":"2024-04-15T23:35:07.900593+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290801+0000","last_change":"2024-04-15T23:35:07.935306+0000","last_active":"2024-04-15T23:35:10.290801+0000","last_peered":"2024-04-15T23:35:10.290801+0000","last_clean":"2024-04-15T23:35:10.290801+0000","last_became_active":"2024-04-15T23:35:07.919625+0000","last_became_peered":"2024-04-15T23:35:07.919625+0000","last_unstale":"2024-04-15T23:35:10.290801+0000","last_undegraded":"2024-04-15T23:35:10.290801+0000","last_fullsized":"2024-04-15T23:35:10.290801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:49:44.043170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":260,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.902230+0000","last_change":"2024-04-15T23:35:07.904291+0000","last_active":"2024-04-15T23:35:06.902230+0000","last_peered":"2024-04-15T23:35:06.094150+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:32:11.543852+0000","last_became_peered":"2024-04-15T23:32:11.543852+0000","last_unstale":"2024-04-15T23:35:06.902230+0000","last_undegraded":"2024-04-15T23:35:06.902230+0000","last_fullsized":"2024-04-15T23:35:06.902230+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291307+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:35:10.291307+0000","last_peered":"2024-04-15T23:35:10.291307+0000","last_clean":"2024-04-15T23:35:10.291307+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:35:10.291307+0000","last_undegraded":"2024-04-15T23:35:10.291307+0000","last_fullsized":"2024-04-15T23:35:10.291307+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":159,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902608+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:35:07.902608+0000","last_peered":"2024-04-15T23:35:07.902608+0000","last_clean":"2024-04-15T23:35:07.902608+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:35:07.902608+0000","last_undegraded":"2024-04-15T23:35:07.902608+0000","last_fullsized":"2024-04-15T23:35:07.902608+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":238,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093486+0000","last_change":"2024-04-15T23:35:07.904347+0000","last_active":"2024-04-15T23:35:07.904347+0000","last_peered":"2024-04-15T23:35:06.093486+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543464+0000","last_became_peered":"2024-04-15T23:32:11.543464+0000","last_unstale":"2024-04-15T23:35:06.093486+0000","last_undegraded":"2024-04-15T23:33:01.579673+0000","last_fullsized":"2024-04-15T23:32:11.540108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919852+0000","last_change":"2024-04-15T23:35:07.919852+0000","last_active":"2024-04-15T23:35:07.919852+0000","last_peered":"2024-04-15T23:35:07.919852+0000","last_clean":"2024-04-15T23:35:07.919852+0000","last_became_active":"2024-04-15T23:35:07.919642+0000","last_became_peered":"2024-04-15T23:35:07.919642+0000","last_unstale":"2024-04-15T23:35:07.919852+0000","last_undegraded":"2024-04-15T23:35:07.919852+0000","last_fullsized":"2024-04-15T23:35:07.919852+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:29.682287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923775+0000","last_change":"2024-04-15T23:35:07.923775+0000","last_active":"2024-04-15T23:35:07.923775+0000","last_peered":"2024-04-15T23:35:07.923775+0000","last_clean":"2024-04-15T23:35:07.923775+0000","last_became_active":"2024-04-15T23:35:07.923310+0000","last_became_peered":"2024-04-15T23:35:07.923310+0000","last_unstale":"2024-04-15T23:35:07.923775+0000","last_undegraded":"2024-04-15T23:35:07.923775+0000","last_fullsized":"2024-04-15T23:35:07.923775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:44.456832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":231,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092917+0000","last_change":"2024-04-15T23:35:07.901562+0000","last_active":"2024-04-15T23:35:07.901562+0000","last_peered":"2024-04-15T23:35:06.092917+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542992+0000","last_became_peered":"2024-04-15T23:32:11.542992+0000","last_unstale":"2024-04-15T23:35:06.092917+0000","last_undegraded":"2024-04-15T23:33:04.175963+0000","last_fullsized":"2024-04-15T23:32:11.540105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.919638+0000","last_change":"2024-04-15T23:35:07.919638+0000","last_active":"2024-04-15T23:35:07.919638+0000","last_peered":"2024-04-15T23:35:07.919638+0000","last_clean":"2024-04-15T23:35:07.919638+0000","last_became_active":"2024-04-15T23:35:07.919325+0000","last_became_peered":"2024-04-15T23:35:07.919325+0000","last_unstale":"2024-04-15T23:35:07.919638+0000","last_undegraded":"2024-04-15T23:35:07.919638+0000","last_fullsized":"2024-04-15T23:35:07.919638+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:20.779700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291371+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:35:10.291371+0000","last_peered":"2024-04-15T23:35:10.291371+0000","last_clean":"2024-04-15T23:35:10.291371+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:35:10.291371+0000","last_undegraded":"2024-04-15T23:35:10.291371+0000","last_fullsized":"2024-04-15T23:35:10.291371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":312,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901889+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:35:07.901889+0000","last_peered":"2024-04-15T23:35:07.901889+0000","last_clean":"2024-04-15T23:35:07.901889+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:35:07.901889+0000","last_undegraded":"2024-04-15T23:35:07.901889+0000","last_fullsized":"2024-04-15T23:35:07.901889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291509+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:35:10.291509+0000","last_peered":"2024-04-15T23:35:10.291509+0000","last_clean":"2024-04-15T23:35:10.291509+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:35:10.291509+0000","last_undegraded":"2024-04-15T23:35:10.291509+0000","last_fullsized":"2024-04-15T23:35:10.291509+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.906853+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:35:07.906853+0000","last_peered":"2024-04-15T23:35:07.906853+0000","last_clean":"2024-04-15T23:35:07.906853+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:35:07.906853+0000","last_undegraded":"2024-04-15T23:35:07.906853+0000","last_fullsized":"2024-04-15T23:35:07.906853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":281,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902039+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:35:07.902039+0000","last_peered":"2024-04-15T23:35:07.902039+0000","last_clean":"2024-04-15T23:35:07.902039+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:35:07.902039+0000","last_undegraded":"2024-04-15T23:35:07.902039+0000","last_fullsized":"2024-04-15T23:35:07.902039+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292195+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:35:10.292195+0000","last_peered":"2024-04-15T23:35:10.292195+0000","last_clean":"2024-04-15T23:35:10.292195+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:35:10.292195+0000","last_undegraded":"2024-04-15T23:35:10.292195+0000","last_fullsized":"2024-04-15T23:35:10.292195+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291681+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:35:10.291681+0000","last_peered":"2024-04-15T23:35:10.291681+0000","last_clean":"2024-04-15T23:35:10.291681+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:35:10.291681+0000","last_undegraded":"2024-04-15T23:35:10.291681+0000","last_fullsized":"2024-04-15T23:35:10.291681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":229,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.895269+0000","last_change":"2024-04-15T23:35:07.899081+0000","last_active":"2024-04-15T23:35:07.899081+0000","last_peered":"2024-04-15T23:35:05.895269+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544726+0000","last_became_peered":"2024-04-15T23:32:11.544726+0000","last_unstale":"2024-04-15T23:35:05.895269+0000","last_undegraded":"2024-04-15T23:33:01.573690+0000","last_fullsized":"2024-04-15T23:32:11.542306+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291688+0000","last_change":"2024-04-15T23:35:07.961077+0000","last_active":"2024-04-15T23:35:10.291688+0000","last_peered":"2024-04-15T23:35:10.291688+0000","last_clean":"2024-04-15T23:35:10.291688+0000","last_became_active":"2024-04-15T23:35:07.924404+0000","last_became_peered":"2024-04-15T23:35:07.924404+0000","last_unstale":"2024-04-15T23:35:10.291688+0000","last_undegraded":"2024-04-15T23:35:10.291688+0000","last_fullsized":"2024-04-15T23:35:10.291688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:26.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.901672+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:35:07.901672+0000","last_peered":"2024-04-15T23:35:07.901672+0000","last_clean":"2024-04-15T23:35:07.901672+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:35:07.901672+0000","last_undegraded":"2024-04-15T23:35:07.901672+0000","last_fullsized":"2024-04-15T23:35:07.901672+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":243,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.902940+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:35:07.902940+0000","last_peered":"2024-04-15T23:35:07.902940+0000","last_clean":"2024-04-15T23:35:07.902940+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:35:07.902940+0000","last_undegraded":"2024-04-15T23:35:07.902940+0000","last_fullsized":"2024-04-15T23:35:07.902940+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":256,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.916138+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:35:07.916138+0000","last_peered":"2024-04-15T23:35:07.916138+0000","last_clean":"2024-04-15T23:35:07.916138+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:35:07.916138+0000","last_undegraded":"2024-04-15T23:35:07.916138+0000","last_fullsized":"2024-04-15T23:35:07.916138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":146,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.916498+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:35:07.916498+0000","last_peered":"2024-04-15T23:35:07.916498+0000","last_clean":"2024-04-15T23:35:07.916498+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:35:07.916498+0000","last_undegraded":"2024-04-15T23:35:07.916498+0000","last_fullsized":"2024-04-15T23:35:07.916498+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":221,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092804+0000","last_change":"2024-04-15T23:35:07.901573+0000","last_active":"2024-04-15T23:35:07.901573+0000","last_peered":"2024-04-15T23:35:06.092804+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542068+0000","last_became_peered":"2024-04-15T23:32:11.542068+0000","last_unstale":"2024-04-15T23:35:06.092804+0000","last_undegraded":"2024-04-15T23:33:04.225125+0000","last_fullsized":"2024-04-15T23:32:11.539597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":126,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905532+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:35:07.905532+0000","last_peered":"2024-04-15T23:35:07.905532+0000","last_clean":"2024-04-15T23:35:07.905532+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:35:07.905532+0000","last_undegraded":"2024-04-15T23:35:07.905532+0000","last_fullsized":"2024-04-15T23:35:07.905532+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":110,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923603+0000","last_change":"2024-04-15T23:35:07.923603+0000","last_active":"2024-04-15T23:35:07.923603+0000","last_peered":"2024-04-15T23:35:07.923603+0000","last_clean":"2024-04-15T23:35:07.923603+0000","last_became_active":"2024-04-15T23:35:07.923069+0000","last_became_peered":"2024-04-15T23:35:07.923069+0000","last_unstale":"2024-04-15T23:35:07.923603+0000","last_undegraded":"2024-04-15T23:35:07.923603+0000","last_fullsized":"2024-04-15T23:35:07.923603+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:39.536190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":257,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.295722+0000","last_change":"2024-04-15T23:35:10.295722+0000","last_active":"2024-04-15T23:35:10.295722+0000","last_peered":"2024-04-15T23:35:10.295722+0000","last_clean":"2024-04-15T23:35:10.295722+0000","last_became_active":"2024-04-15T23:35:10.294673+0000","last_became_peered":"2024-04-15T23:35:10.294673+0000","last_unstale":"2024-04-15T23:35:10.295722+0000","last_undegraded":"2024-04-15T23:35:10.295722+0000","last_fullsized":"2024-04-15T23:35:10.295722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:19.610009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292274+0000","last_change":"2024-04-15T23:35:07.923646+0000","last_active":"2024-04-15T23:35:10.292274+0000","last_peered":"2024-04-15T23:35:10.292274+0000","last_clean":"2024-04-15T23:35:10.292274+0000","last_became_active":"2024-04-15T23:35:07.923298+0000","last_became_peered":"2024-04-15T23:35:07.923298+0000","last_unstale":"2024-04-15T23:35:10.292274+0000","last_undegraded":"2024-04-15T23:35:10.292274+0000","last_fullsized":"2024-04-15T23:35:10.292274+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:01.524255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.302738+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:35:10.302738+0000","last_peered":"2024-04-15T23:35:10.302738+0000","last_clean":"2024-04-15T23:35:10.302738+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:35:10.302738+0000","last_undegraded":"2024-04-15T23:35:10.302738+0000","last_fullsized":"2024-04-15T23:35:10.302738+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":272,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.905550+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:35:07.905550+0000","last_peered":"2024-04-15T23:35:07.905550+0000","last_clean":"2024-04-15T23:35:07.905550+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:35:07.905550+0000","last_undegraded":"2024-04-15T23:35:07.905550+0000","last_fullsized":"2024-04-15T23:35:07.905550+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290687+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:35:10.290687+0000","last_peered":"2024-04-15T23:35:10.290687+0000","last_clean":"2024-04-15T23:35:10.290687+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:35:10.290687+0000","last_undegraded":"2024-04-15T23:35:10.290687+0000","last_fullsized":"2024-04-15T23:35:10.290687+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":231,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.897081+0000","last_change":"2024-04-15T23:35:07.901641+0000","last_active":"2024-04-15T23:35:07.901641+0000","last_peered":"2024-04-15T23:35:05.897081+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:35:05.897081+0000","last_undegraded":"2024-04-15T23:33:04.164120+0000","last_fullsized":"2024-04-15T23:32:11.544284+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290735+0000","last_change":"2024-04-15T23:35:07.917897+0000","last_active":"2024-04-15T23:35:10.290735+0000","last_peered":"2024-04-15T23:35:10.290735+0000","last_clean":"2024-04-15T23:35:10.290735+0000","last_became_active":"2024-04-15T23:35:07.917508+0000","last_became_peered":"2024-04-15T23:35:07.917508+0000","last_unstale":"2024-04-15T23:35:10.290735+0000","last_undegraded":"2024-04-15T23:35:10.290735+0000","last_fullsized":"2024-04-15T23:35:10.290735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:41:58.784211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":249,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903307+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:35:07.903307+0000","last_peered":"2024-04-15T23:35:07.903307+0000","last_clean":"2024-04-15T23:35:07.903307+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:35:07.903307+0000","last_undegraded":"2024-04-15T23:35:07.903307+0000","last_fullsized":"2024-04-15T23:35:07.903307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":117,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.932913+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:35:07.932913+0000","last_peered":"2024-04-15T23:35:07.932913+0000","last_clean":"2024-04-15T23:35:07.932913+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:35:07.932913+0000","last_undegraded":"2024-04-15T23:35:07.932913+0000","last_fullsized":"2024-04-15T23:35:07.932913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":261,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.900548+0000","last_change":"2024-04-15T23:35:07.903100+0000","last_active":"2024-04-15T23:35:06.900548+0000","last_peered":"2024-04-15T23:35:06.093544+0000","last_clean":"2024-04-15T23:32:07.533902+0000","last_became_active":"2024-04-15T23:32:11.543802+0000","last_became_peered":"2024-04-15T23:32:11.543802+0000","last_unstale":"2024-04-15T23:35:06.900548+0000","last_undegraded":"2024-04-15T23:35:06.900548+0000","last_fullsized":"2024-04-15T23:35:06.900548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":108,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.903048+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:35:07.903048+0000","last_peered":"2024-04-15T23:35:07.903048+0000","last_clean":"2024-04-15T23:35:07.903048+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:35:07.903048+0000","last_undegraded":"2024-04-15T23:35:07.903048+0000","last_fullsized":"2024-04-15T23:35:07.903048+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":264,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.904708+0000","last_change":"2024-04-15T23:35:07.901803+0000","last_active":"2024-04-15T23:35:06.904708+0000","last_peered":"2024-04-15T23:35:05.895982+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:32:11.545464+0000","last_became_peered":"2024-04-15T23:32:11.545464+0000","last_unstale":"2024-04-15T23:35:06.904708+0000","last_undegraded":"2024-04-15T23:35:06.904708+0000","last_fullsized":"2024-04-15T23:35:06.904708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":112,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.923605+0000","last_change":"2024-04-15T23:35:07.923605+0000","last_active":"2024-04-15T23:35:07.923605+0000","last_peered":"2024-04-15T23:35:07.923605+0000","last_clean":"2024-04-15T23:35:07.923605+0000","last_became_active":"2024-04-15T23:35:07.923048+0000","last_became_peered":"2024-04-15T23:35:07.923048+0000","last_unstale":"2024-04-15T23:35:07.923605+0000","last_undegraded":"2024-04-15T23:35:07.923605+0000","last_fullsized":"2024-04-15T23:35:07.923605+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:24.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":260,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.906284+0000","last_change":"2024-04-15T23:35:07.916055+0000","last_active":"2024-04-15T23:35:06.906284+0000","last_peered":"2024-04-15T23:35:05.896380+0000","last_clean":"2024-04-15T23:32:07.786529+0000","last_became_active":"2024-04-15T23:32:11.547235+0000","last_became_peered":"2024-04-15T23:32:11.547235+0000","last_unstale":"2024-04-15T23:35:06.906284+0000","last_undegraded":"2024-04-15T23:35:06.906284+0000","last_fullsized":"2024-04-15T23:35:06.906284+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":162,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-15T23:35:07.904796+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:35:07.904796+0000","last_peered":"2024-04-15T23:35:07.904796+0000","last_clean":"2024-04-15T23:35:07.904796+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:35:07.904796+0000","last_undegraded":"2024-04-15T23:35:07.904796+0000","last_fullsized":"2024-04-15T23:35:07.904796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":268,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.901530+0000","last_change":"2024-04-15T23:35:07.904557+0000","last_active":"2024-04-15T23:35:06.901530+0000","last_peered":"2024-04-15T23:35:06.093717+0000","last_clean":"2024-04-15T23:32:07.533827+0000","last_became_active":"2024-04-15T23:32:11.543217+0000","last_became_peered":"2024-04-15T23:32:11.543217+0000","last_unstale":"2024-04-15T23:35:06.901530+0000","last_undegraded":"2024-04-15T23:35:06.901530+0000","last_fullsized":"2024-04-15T23:35:06.901530+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292005+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:35:10.292005+0000","last_peered":"2024-04-15T23:35:10.292005+0000","last_clean":"2024-04-15T23:35:10.292005+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:35:10.292005+0000","last_undegraded":"2024-04-15T23:35:10.292005+0000","last_fullsized":"2024-04-15T23:35:10.292005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":290,"reported_epoch":58,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.901135+0000","last_change":"2024-04-15T23:35:07.901208+0000","last_active":"2024-04-15T23:35:06.901135+0000","last_peered":"2024-04-15T23:35:05.895938+0000","last_clean":"2024-04-15T23:32:07.786282+0000","last_became_active":"2024-04-15T23:32:11.548138+0000","last_became_peered":"2024-04-15T23:32:11.548138+0000","last_unstale":"2024-04-15T23:35:06.901135+0000","last_undegraded":"2024-04-15T23:35:06.901135+0000","last_fullsized":"2024-04-15T23:35:06.901135+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292065+0000","last_change":"2024-04-15T23:35:07.956652+0000","last_active":"2024-04-15T23:35:10.292065+0000","last_peered":"2024-04-15T23:35:10.292065+0000","last_clean":"2024-04-15T23:35:10.292065+0000","last_became_active":"2024-04-15T23:35:07.923145+0000","last_became_peered":"2024-04-15T23:35:07.923145+0000","last_unstale":"2024-04-15T23:35:10.292065+0000","last_undegraded":"2024-04-15T23:35:10.292065+0000","last_fullsized":"2024-04-15T23:35:10.292065+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:50:11.946892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":435,"num_bytes_recovered":433886,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53833728,"data_stored":38400819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":63,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103170,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54736,"kb_used_data":23040,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94317104,"statfs":{"total":96636764160,"available":96580714496,"internally_reserved":0,"allocated":23592960,"data_stored":22021809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":32433383},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738417,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83760,"kb_used_data":52580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94288080,"statfs":{"total":96636764160,"available":96550993920,"internally_reserved":0,"allocated":53841920,"data_stored":46983214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738415,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88740,"kb_used_data":57560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283100,"statfs":{"total":96636764160,"available":96545894400,"internally_reserved":0,"allocated":58941440,"data_stored":52086637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19513344,"data_stored":12945571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5849088,"data_stored":3559202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:35:13.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-15T23:35:14.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:14.339 INFO:teuthology.orchestra.run.smithi102.stdout:{"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":238,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":66,"num_osds":3,"num_up_osds":3,"osd_up_since":1713224106,"num_in_osds":3,"osd_in_since":1713223876,"num_remapped_pgs":5},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":63},{"state_name":"remapped+peering","count":42}],"num_pgs":105,"num_pools":4,"num_objects":3481,"data_bytes":68767978,"bytes_used":232689664,"bytes_avail":289677602816,"bytes_total":289910292480,"inactive_pgs_ratio":0.40000000596046448,"recovering_objects_per_sec":112,"recovering_bytes_per_sec":3408097,"recovering_keys_per_sec":0,"num_objects_recovered":440,"num_bytes_recovered":13344442,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4218}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-15T23:32:37.780770+0000","services":{}},"progress_events":{}} 2024-04-15T23:35:14.354 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-15T23:35:14.355 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:35:14.645 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:14.646 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:35:14.655 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-04-15T23:35:14.294455+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":732,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3011,"num_bytes_recovered":31595642,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":189,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":227380,"kb_used_data":133324,"kb_used_omap":9,"kb_used_meta":94006,"kb_avail":282888140,"statfs":{"total":289910292480,"available":289677455360,"internally_reserved":0,"allocated":136523776,"data_stored":121152970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":96262257},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":723,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3010,"num_bytes_recovered":27401338,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.004519"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":476,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.299821+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:35:13.299821+0000","last_peered":"2024-04-15T23:35:13.299821+0000","last_clean":"2024-04-15T23:35:13.299821+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:35:13.299821+0000","last_undegraded":"2024-04-15T23:35:13.299821+0000","last_fullsized":"2024-04-15T23:35:13.299821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":446,"reported_epoch":65,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-15T23:35:13.855054+0000","last_change":"2024-04-15T23:35:13.836134+0000","last_active":"2024-04-15T23:35:13.855054+0000","last_peered":"2024-04-15T23:35:13.855054+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:35:08.966346+0000","last_became_peered":"2024-04-15T23:35:08.966346+0000","last_unstale":"2024-04-15T23:35:13.855054+0000","last_undegraded":"2024-04-15T23:35:13.855054+0000","last_fullsized":"2024-04-15T23:35:08.902876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":282,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297704+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:35:13.297704+0000","last_peered":"2024-04-15T23:35:13.297704+0000","last_clean":"2024-04-15T23:35:13.297704+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:35:13.297704+0000","last_undegraded":"2024-04-15T23:35:13.297704+0000","last_fullsized":"2024-04-15T23:35:13.297704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":414,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.467475+0000","last_change":"2024-04-15T23:35:13.297397+0000","last_active":"2024-04-15T23:35:13.297397+0000","last_peered":"2024-04-15T23:35:12.467475+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:35:08.964645+0000","last_became_peered":"2024-04-15T23:35:08.964645+0000","last_unstale":"2024-04-15T23:35:12.467475+0000","last_undegraded":"2024-04-15T23:35:12.467475+0000","last_fullsized":"2024-04-15T23:35:08.904509+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":139423,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":290,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295640+0000","last_change":"2024-04-15T23:35:08.967663+0000","last_active":"2024-04-15T23:35:13.295640+0000","last_peered":"2024-04-15T23:35:13.295640+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:35:08.966945+0000","last_became_peered":"2024-04-15T23:35:08.966945+0000","last_unstale":"2024-04-15T23:35:13.295640+0000","last_undegraded":"2024-04-15T23:35:08.906099+0000","last_fullsized":"2024-04-15T23:35:08.904502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":73}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":513,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.303626+0000","last_change":"2024-04-15T23:35:13.303626+0000","last_active":"2024-04-15T23:35:13.303626+0000","last_peered":"2024-04-15T23:35:13.303626+0000","last_clean":"2024-04-15T23:35:13.303626+0000","last_became_active":"2024-04-15T23:35:13.303020+0000","last_became_peered":"2024-04-15T23:35:13.303020+0000","last_unstale":"2024-04-15T23:35:13.303626+0000","last_undegraded":"2024-04-15T23:35:13.303626+0000","last_fullsized":"2024-04-15T23:35:13.303626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:36.526930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":182889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":508,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297253+0000","last_change":"2024-04-15T23:35:11.296974+0000","last_active":"2024-04-15T23:35:13.297253+0000","last_peered":"2024-04-15T23:35:13.297253+0000","last_clean":"2024-04-15T23:35:13.297253+0000","last_became_active":"2024-04-15T23:35:11.296148+0000","last_became_peered":"2024-04-15T23:35:11.296148+0000","last_unstale":"2024-04-15T23:35:13.297253+0000","last_undegraded":"2024-04-15T23:35:13.297253+0000","last_fullsized":"2024-04-15T23:35:13.297253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:54:02.940157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":274228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":439,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297508+0000","last_change":"2024-04-15T23:35:12.299337+0000","last_active":"2024-04-15T23:35:13.297508+0000","last_peered":"2024-04-15T23:35:13.297508+0000","last_clean":"2024-04-15T23:35:13.297508+0000","last_became_active":"2024-04-15T23:35:12.298132+0000","last_became_peered":"2024-04-15T23:35:12.298132+0000","last_unstale":"2024-04-15T23:35:13.297508+0000","last_undegraded":"2024-04-15T23:35:13.297508+0000","last_fullsized":"2024-04-15T23:35:13.297508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:56:07.706157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":98254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":241,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.094642+0000","last_change":"2024-04-15T23:35:07.906227+0000","last_active":"2024-04-15T23:35:07.906227+0000","last_peered":"2024-04-15T23:35:06.094642+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545953+0000","last_became_peered":"2024-04-15T23:32:11.545953+0000","last_unstale":"2024-04-15T23:35:06.094642+0000","last_undegraded":"2024-04-15T23:33:04.251389+0000","last_fullsized":"2024-04-15T23:32:11.541547+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":269,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295221+0000","last_change":"2024-04-15T23:35:08.968933+0000","last_active":"2024-04-15T23:35:13.295221+0000","last_peered":"2024-04-15T23:35:13.295221+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:35:08.968156+0000","last_became_peered":"2024-04-15T23:35:08.968156+0000","last_unstale":"2024-04-15T23:35:13.295221+0000","last_undegraded":"2024-04-15T23:35:08.907306+0000","last_fullsized":"2024-04-15T23:35:08.904735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":52}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":477,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297805+0000","last_change":"2024-04-15T23:35:10.294609+0000","last_active":"2024-04-15T23:35:13.297805+0000","last_peered":"2024-04-15T23:35:13.297805+0000","last_clean":"2024-04-15T23:35:13.297805+0000","last_became_active":"2024-04-15T23:35:10.294222+0000","last_became_peered":"2024-04-15T23:35:10.294222+0000","last_unstale":"2024-04-15T23:35:13.297805+0000","last_undegraded":"2024-04-15T23:35:13.297805+0000","last_fullsized":"2024-04-15T23:35:13.297805+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":192323,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":254,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":427,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:13.093403+0000","last_change":"2024-04-15T23:35:13.296237+0000","last_active":"2024-04-15T23:35:13.296237+0000","last_peered":"2024-04-15T23:35:13.093403+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:35:08.965939+0000","last_became_peered":"2024-04-15T23:35:08.965939+0000","last_unstale":"2024-04-15T23:35:13.093403+0000","last_undegraded":"2024-04-15T23:35:13.093403+0000","last_fullsized":"2024-04-15T23:35:08.902173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":290,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297258+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:35:13.297258+0000","last_peered":"2024-04-15T23:35:13.297258+0000","last_clean":"2024-04-15T23:35:13.297258+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:35:13.297258+0000","last_undegraded":"2024-04-15T23:35:13.297258+0000","last_fullsized":"2024-04-15T23:35:13.297258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":270,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297273+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:35:13.297273+0000","last_peered":"2024-04-15T23:35:13.297273+0000","last_clean":"2024-04-15T23:35:13.297273+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:35:13.297273+0000","last_undegraded":"2024-04-15T23:35:13.297273+0000","last_fullsized":"2024-04-15T23:35:13.297273+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":525,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297566+0000","last_change":"2024-04-15T23:35:12.299129+0000","last_active":"2024-04-15T23:35:13.297566+0000","last_peered":"2024-04-15T23:35:13.297566+0000","last_clean":"2024-04-15T23:35:13.297566+0000","last_became_active":"2024-04-15T23:35:12.298025+0000","last_became_peered":"2024-04-15T23:35:12.298025+0000","last_unstale":"2024-04-15T23:35:13.297566+0000","last_undegraded":"2024-04-15T23:35:13.297566+0000","last_fullsized":"2024-04-15T23:35:13.297566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:08:47.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1487227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":239,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093791+0000","last_change":"2024-04-15T23:35:07.904671+0000","last_active":"2024-04-15T23:35:07.904671+0000","last_peered":"2024-04-15T23:35:06.093791+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543951+0000","last_became_peered":"2024-04-15T23:32:11.543951+0000","last_unstale":"2024-04-15T23:35:06.093791+0000","last_undegraded":"2024-04-15T23:33:04.222718+0000","last_fullsized":"2024-04-15T23:32:11.540820+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":267,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295677+0000","last_change":"2024-04-15T23:35:08.968935+0000","last_active":"2024-04-15T23:35:13.295677+0000","last_peered":"2024-04-15T23:35:13.295677+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:35:08.968128+0000","last_became_peered":"2024-04-15T23:35:08.968128+0000","last_unstale":"2024-04-15T23:35:13.295677+0000","last_undegraded":"2024-04-15T23:35:08.909234+0000","last_fullsized":"2024-04-15T23:35:08.907780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":49}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":245,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295023+0000","last_change":"2024-04-15T23:35:08.968181+0000","last_active":"2024-04-15T23:35:13.295023+0000","last_peered":"2024-04-15T23:35:13.295023+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:35:08.939933+0000","last_became_peered":"2024-04-15T23:35:08.939933+0000","last_unstale":"2024-04-15T23:35:13.295023+0000","last_undegraded":"2024-04-15T23:35:08.904835+0000","last_fullsized":"2024-04-15T23:35:08.902248+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":24987,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":3}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":536,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:13.236358+0000","last_change":"2024-04-15T23:35:13.298540+0000","last_active":"2024-04-15T23:35:13.298540+0000","last_peered":"2024-04-15T23:35:13.236358+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:35:08.966005+0000","last_became_peered":"2024-04-15T23:35:08.966005+0000","last_unstale":"2024-04-15T23:35:13.236358+0000","last_undegraded":"2024-04-15T23:35:13.236358+0000","last_fullsized":"2024-04-15T23:35:08.905437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":244249,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":483,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.497678+0000","last_change":"2024-04-15T23:35:13.497831+0000","last_active":"2024-04-15T23:35:13.497678+0000","last_peered":"2024-04-15T23:35:13.497678+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:35:08.967036+0000","last_became_peered":"2024-04-15T23:35:08.967036+0000","last_unstale":"2024-04-15T23:35:13.497678+0000","last_undegraded":"2024-04-15T23:35:13.497678+0000","last_fullsized":"2024-04-15T23:35:08.907738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87443,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":54}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":283,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294885+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:35:13.294885+0000","last_peered":"2024-04-15T23:35:13.294885+0000","last_clean":"2024-04-15T23:35:13.294885+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:35:13.294885+0000","last_undegraded":"2024-04-15T23:35:13.294885+0000","last_fullsized":"2024-04-15T23:35:13.294885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":247,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.294643+0000","last_change":"2024-04-15T23:35:10.294643+0000","last_active":"2024-04-15T23:35:10.294643+0000","last_peered":"2024-04-15T23:35:10.294643+0000","last_clean":"2024-04-15T23:35:10.294643+0000","last_became_active":"2024-04-15T23:35:10.293497+0000","last_became_peered":"2024-04-15T23:35:10.293497+0000","last_unstale":"2024-04-15T23:35:10.294643+0000","last_undegraded":"2024-04-15T23:35:10.294643+0000","last_fullsized":"2024-04-15T23:35:10.294643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:12:59.503325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":499,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294682+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:35:13.294682+0000","last_peered":"2024-04-15T23:35:13.294682+0000","last_clean":"2024-04-15T23:35:13.294682+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:35:13.294682+0000","last_undegraded":"2024-04-15T23:35:13.294682+0000","last_fullsized":"2024-04-15T23:35:13.294682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":269,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296097+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:35:13.296097+0000","last_peered":"2024-04-15T23:35:13.296097+0000","last_clean":"2024-04-15T23:35:13.296097+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:35:13.296097+0000","last_undegraded":"2024-04-15T23:35:13.296097+0000","last_fullsized":"2024-04-15T23:35:13.296097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":280,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.298644+0000","last_change":"2024-04-15T23:35:08.969855+0000","last_active":"2024-04-15T23:35:13.298644+0000","last_peered":"2024-04-15T23:35:13.298644+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:35:08.969182+0000","last_became_peered":"2024-04-15T23:35:08.969182+0000","last_unstale":"2024-04-15T23:35:13.298644+0000","last_undegraded":"2024-04-15T23:35:08.912208+0000","last_fullsized":"2024-04-15T23:35:08.910910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":59}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":273,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297895+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:35:13.297895+0000","last_peered":"2024-04-15T23:35:13.297895+0000","last_clean":"2024-04-15T23:35:13.297895+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:35:13.297895+0000","last_undegraded":"2024-04-15T23:35:13.297895+0000","last_fullsized":"2024-04-15T23:35:13.297895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":264,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296281+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:35:13.296281+0000","last_peered":"2024-04-15T23:35:13.296281+0000","last_clean":"2024-04-15T23:35:13.296281+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:35:13.296281+0000","last_undegraded":"2024-04-15T23:35:13.296281+0000","last_fullsized":"2024-04-15T23:35:13.296281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":471,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.373689+0000","last_change":"2024-04-15T23:35:13.373841+0000","last_active":"2024-04-15T23:35:13.373689+0000","last_peered":"2024-04-15T23:35:13.373689+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:35:08.965943+0000","last_became_peered":"2024-04-15T23:35:08.965943+0000","last_unstale":"2024-04-15T23:35:13.373689+0000","last_undegraded":"2024-04-15T23:35:13.373689+0000","last_fullsized":"2024-04-15T23:35:08.901994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":55}],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":306,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294986+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:35:13.294986+0000","last_peered":"2024-04-15T23:35:13.294986+0000","last_clean":"2024-04-15T23:35:13.294986+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:35:13.294986+0000","last_undegraded":"2024-04-15T23:35:13.294986+0000","last_fullsized":"2024-04-15T23:35:13.294986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":271,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.299527+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:35:10.299527+0000","last_peered":"2024-04-15T23:35:10.299527+0000","last_clean":"2024-04-15T23:35:10.299527+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:35:10.299527+0000","last_undegraded":"2024-04-15T23:35:10.299527+0000","last_fullsized":"2024-04-15T23:35:10.299527+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":537,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297604+0000","last_change":"2024-04-15T23:35:11.297293+0000","last_active":"2024-04-15T23:35:13.297604+0000","last_peered":"2024-04-15T23:35:13.297604+0000","last_clean":"2024-04-15T23:35:13.297604+0000","last_became_active":"2024-04-15T23:35:11.296756+0000","last_became_peered":"2024-04-15T23:35:11.296756+0000","last_unstale":"2024-04-15T23:35:13.297604+0000","last_undegraded":"2024-04-15T23:35:13.297604+0000","last_fullsized":"2024-04-15T23:35:13.297604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:58:45.896248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":127328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":457,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.577377+0000","last_change":"2024-04-15T23:35:13.296053+0000","last_active":"2024-04-15T23:35:13.296053+0000","last_peered":"2024-04-15T23:35:12.577377+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:35:08.965317+0000","last_became_peered":"2024-04-15T23:35:08.965317+0000","last_unstale":"2024-04-15T23:35:12.577377+0000","last_undegraded":"2024-04-15T23:35:12.577377+0000","last_fullsized":"2024-04-15T23:35:08.906044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298212+0000","last_change":"2024-04-15T23:35:10.294028+0000","last_active":"2024-04-15T23:35:13.298212+0000","last_peered":"2024-04-15T23:35:13.298212+0000","last_clean":"2024-04-15T23:35:13.298212+0000","last_became_active":"2024-04-15T23:35:10.293804+0000","last_became_peered":"2024-04-15T23:35:10.293804+0000","last_unstale":"2024-04-15T23:35:13.298212+0000","last_undegraded":"2024-04-15T23:35:13.298212+0000","last_fullsized":"2024-04-15T23:35:13.298212+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:14.050412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3518792,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":462,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295398+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:35:13.295398+0000","last_peered":"2024-04-15T23:35:13.295398+0000","last_clean":"2024-04-15T23:35:13.295398+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:35:13.295398+0000","last_undegraded":"2024-04-15T23:35:13.295398+0000","last_fullsized":"2024-04-15T23:35:13.295398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290951+0000","last_change":"2024-04-15T23:35:07.923327+0000","last_active":"2024-04-15T23:35:10.290951+0000","last_peered":"2024-04-15T23:35:10.290951+0000","last_clean":"2024-04-15T23:35:10.290951+0000","last_became_active":"2024-04-15T23:35:07.923022+0000","last_became_peered":"2024-04-15T23:35:07.923022+0000","last_unstale":"2024-04-15T23:35:10.290951+0000","last_undegraded":"2024-04-15T23:35:10.290951+0000","last_fullsized":"2024-04-15T23:35:10.290951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:56.197588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":282,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.297711+0000","last_change":"2024-04-15T23:35:08.969053+0000","last_active":"2024-04-15T23:35:13.297711+0000","last_peered":"2024-04-15T23:35:13.297711+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:35:08.968046+0000","last_became_peered":"2024-04-15T23:35:08.968046+0000","last_unstale":"2024-04-15T23:35:13.297711+0000","last_undegraded":"2024-04-15T23:35:08.909576+0000","last_fullsized":"2024-04-15T23:35:08.904616+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":116,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":51}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294857+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:35:13.294857+0000","last_peered":"2024-04-15T23:35:13.294857+0000","last_clean":"2024-04-15T23:35:13.294857+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:35:13.294857+0000","last_undegraded":"2024-04-15T23:35:13.294857+0000","last_fullsized":"2024-04-15T23:35:13.294857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":252,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.896657+0000","last_change":"2024-04-15T23:35:07.900977+0000","last_active":"2024-04-15T23:35:07.900977+0000","last_peered":"2024-04-15T23:35:05.896657+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547018+0000","last_became_peered":"2024-04-15T23:32:11.547018+0000","last_unstale":"2024-04-15T23:35:05.896657+0000","last_undegraded":"2024-04-15T23:33:04.171797+0000","last_fullsized":"2024-04-15T23:32:11.543473+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":124,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297842+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:35:13.297842+0000","last_peered":"2024-04-15T23:35:13.297842+0000","last_clean":"2024-04-15T23:35:13.297842+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:35:13.297842+0000","last_undegraded":"2024-04-15T23:35:13.297842+0000","last_fullsized":"2024-04-15T23:35:13.297842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":116,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298229+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:35:13.298229+0000","last_peered":"2024-04-15T23:35:13.298229+0000","last_clean":"2024-04-15T23:35:13.298229+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:35:13.298229+0000","last_undegraded":"2024-04-15T23:35:13.298229+0000","last_fullsized":"2024-04-15T23:35:13.298229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":266,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294692+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:35:13.294692+0000","last_peered":"2024-04-15T23:35:13.294692+0000","last_clean":"2024-04-15T23:35:13.294692+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:35:13.294692+0000","last_undegraded":"2024-04-15T23:35:13.294692+0000","last_fullsized":"2024-04-15T23:35:13.294692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":118,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295849+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:35:13.295849+0000","last_peered":"2024-04-15T23:35:13.295849+0000","last_clean":"2024-04-15T23:35:13.295849+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:35:13.295849+0000","last_undegraded":"2024-04-15T23:35:13.295849+0000","last_fullsized":"2024-04-15T23:35:13.295849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":536,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294757+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:35:13.294757+0000","last_peered":"2024-04-15T23:35:13.294757+0000","last_clean":"2024-04-15T23:35:13.294757+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:35:13.294757+0000","last_undegraded":"2024-04-15T23:35:13.294757+0000","last_fullsized":"2024-04-15T23:35:13.294757+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":116,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298172+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:35:13.298172+0000","last_peered":"2024-04-15T23:35:13.298172+0000","last_clean":"2024-04-15T23:35:13.298172+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:35:13.298172+0000","last_undegraded":"2024-04-15T23:35:13.298172+0000","last_fullsized":"2024-04-15T23:35:13.298172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":467,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.300527+0000","last_change":"2024-04-15T23:35:13.300527+0000","last_active":"2024-04-15T23:35:13.300527+0000","last_peered":"2024-04-15T23:35:13.300527+0000","last_clean":"2024-04-15T23:35:13.300527+0000","last_became_active":"2024-04-15T23:35:13.300095+0000","last_became_peered":"2024-04-15T23:35:13.300095+0000","last_unstale":"2024-04-15T23:35:13.300527+0000","last_undegraded":"2024-04-15T23:35:13.300527+0000","last_fullsized":"2024-04-15T23:35:13.300527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:44.585807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":66508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":123,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298559+0000","last_change":"2024-04-15T23:35:07.923940+0000","last_active":"2024-04-15T23:35:13.298559+0000","last_peered":"2024-04-15T23:35:13.298559+0000","last_clean":"2024-04-15T23:35:13.298559+0000","last_became_active":"2024-04-15T23:35:07.923559+0000","last_became_peered":"2024-04-15T23:35:07.923559+0000","last_unstale":"2024-04-15T23:35:13.298559+0000","last_undegraded":"2024-04-15T23:35:13.298559+0000","last_fullsized":"2024-04-15T23:35:13.298559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:34.992257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":230,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.895674+0000","last_change":"2024-04-15T23:35:07.901912+0000","last_active":"2024-04-15T23:35:07.901912+0000","last_peered":"2024-04-15T23:35:05.895674+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.545235+0000","last_became_peered":"2024-04-15T23:32:11.545235+0000","last_unstale":"2024-04-15T23:35:05.895674+0000","last_undegraded":"2024-04-15T23:33:04.172129+0000","last_fullsized":"2024-04-15T23:32:11.542558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291162+0000","last_change":"2024-04-15T23:35:07.979404+0000","last_active":"2024-04-15T23:35:10.291162+0000","last_peered":"2024-04-15T23:35:10.291162+0000","last_clean":"2024-04-15T23:35:10.291162+0000","last_became_active":"2024-04-15T23:35:07.924742+0000","last_became_peered":"2024-04-15T23:35:07.924742+0000","last_unstale":"2024-04-15T23:35:10.291162+0000","last_undegraded":"2024-04-15T23:35:10.291162+0000","last_fullsized":"2024-04-15T23:35:10.291162+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:59.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":529,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.748974+0000","last_change":"2024-04-15T23:35:13.749125+0000","last_active":"2024-04-15T23:35:13.748974+0000","last_peered":"2024-04-15T23:35:13.748974+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:35:08.968016+0000","last_became_peered":"2024-04-15T23:35:08.968016+0000","last_unstale":"2024-04-15T23:35:13.748974+0000","last_undegraded":"2024-04-15T23:35:13.748974+0000","last_fullsized":"2024-04-15T23:35:08.909140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":91970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297486+0000","last_change":"2024-04-15T23:35:07.919642+0000","last_active":"2024-04-15T23:35:13.297486+0000","last_peered":"2024-04-15T23:35:13.297486+0000","last_clean":"2024-04-15T23:35:13.297486+0000","last_became_active":"2024-04-15T23:35:07.919354+0000","last_became_peered":"2024-04-15T23:35:07.919354+0000","last_unstale":"2024-04-15T23:35:13.297486+0000","last_undegraded":"2024-04-15T23:35:13.297486+0000","last_fullsized":"2024-04-15T23:35:13.297486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:24.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":279,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298064+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:35:13.298064+0000","last_peered":"2024-04-15T23:35:13.298064+0000","last_clean":"2024-04-15T23:35:13.298064+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:35:13.298064+0000","last_undegraded":"2024-04-15T23:35:13.298064+0000","last_fullsized":"2024-04-15T23:35:13.298064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":251,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298638+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:35:13.298638+0000","last_peered":"2024-04-15T23:35:13.298638+0000","last_clean":"2024-04-15T23:35:13.298638+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:35:13.298638+0000","last_undegraded":"2024-04-15T23:35:13.298638+0000","last_fullsized":"2024-04-15T23:35:13.298638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":123,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294792+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:35:13.294792+0000","last_peered":"2024-04-15T23:35:13.294792+0000","last_clean":"2024-04-15T23:35:13.294792+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:35:13.294792+0000","last_undegraded":"2024-04-15T23:35:13.294792+0000","last_fullsized":"2024-04-15T23:35:13.294792+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":219,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093956+0000","last_change":"2024-04-15T23:35:07.903520+0000","last_active":"2024-04-15T23:35:07.903520+0000","last_peered":"2024-04-15T23:35:06.093956+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543916+0000","last_became_peered":"2024-04-15T23:32:11.543916+0000","last_unstale":"2024-04-15T23:35:06.093956+0000","last_undegraded":"2024-04-15T23:33:04.173908+0000","last_fullsized":"2024-04-15T23:32:11.540434+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":317,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297884+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:35:13.297884+0000","last_peered":"2024-04-15T23:35:13.297884+0000","last_clean":"2024-04-15T23:35:13.297884+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:35:13.297884+0000","last_undegraded":"2024-04-15T23:35:13.297884+0000","last_fullsized":"2024-04-15T23:35:13.297884+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298552+0000","last_change":"2024-04-15T23:35:07.919572+0000","last_active":"2024-04-15T23:35:13.298552+0000","last_peered":"2024-04-15T23:35:13.298552+0000","last_clean":"2024-04-15T23:35:13.298552+0000","last_became_active":"2024-04-15T23:35:07.919258+0000","last_became_peered":"2024-04-15T23:35:07.919258+0000","last_unstale":"2024-04-15T23:35:13.298552+0000","last_undegraded":"2024-04-15T23:35:13.298552+0000","last_fullsized":"2024-04-15T23:35:13.298552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:56.248931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291164+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:35:10.291164+0000","last_peered":"2024-04-15T23:35:10.291164+0000","last_clean":"2024-04-15T23:35:10.291164+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:35:10.291164+0000","last_undegraded":"2024-04-15T23:35:10.291164+0000","last_fullsized":"2024-04-15T23:35:10.291164+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":264,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298128+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:35:13.298128+0000","last_peered":"2024-04-15T23:35:13.298128+0000","last_clean":"2024-04-15T23:35:13.298128+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:35:13.298128+0000","last_undegraded":"2024-04-15T23:35:13.298128+0000","last_fullsized":"2024-04-15T23:35:13.298128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297801+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:35:13.297801+0000","last_peered":"2024-04-15T23:35:13.297801+0000","last_clean":"2024-04-15T23:35:13.297801+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:35:13.297801+0000","last_undegraded":"2024-04-15T23:35:13.297801+0000","last_fullsized":"2024-04-15T23:35:13.297801+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290801+0000","last_change":"2024-04-15T23:35:07.935306+0000","last_active":"2024-04-15T23:35:10.290801+0000","last_peered":"2024-04-15T23:35:10.290801+0000","last_clean":"2024-04-15T23:35:10.290801+0000","last_became_active":"2024-04-15T23:35:07.919625+0000","last_became_peered":"2024-04-15T23:35:07.919625+0000","last_unstale":"2024-04-15T23:35:10.290801+0000","last_undegraded":"2024-04-15T23:35:10.290801+0000","last_fullsized":"2024-04-15T23:35:10.290801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:49:44.043170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":486,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.620762+0000","last_change":"2024-04-15T23:35:13.620914+0000","last_active":"2024-04-15T23:35:13.620762+0000","last_peered":"2024-04-15T23:35:13.620762+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:35:08.966327+0000","last_became_peered":"2024-04-15T23:35:08.966327+0000","last_unstale":"2024-04-15T23:35:13.620762+0000","last_undegraded":"2024-04-15T23:35:08.907357+0000","last_fullsized":"2024-04-15T23:35:08.904728+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":57}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291307+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:35:10.291307+0000","last_peered":"2024-04-15T23:35:10.291307+0000","last_clean":"2024-04-15T23:35:10.291307+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:35:10.291307+0000","last_undegraded":"2024-04-15T23:35:10.291307+0000","last_fullsized":"2024-04-15T23:35:10.291307+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294825+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:35:13.294825+0000","last_peered":"2024-04-15T23:35:13.294825+0000","last_clean":"2024-04-15T23:35:13.294825+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:35:13.294825+0000","last_undegraded":"2024-04-15T23:35:13.294825+0000","last_fullsized":"2024-04-15T23:35:13.294825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":238,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.093486+0000","last_change":"2024-04-15T23:35:07.904347+0000","last_active":"2024-04-15T23:35:07.904347+0000","last_peered":"2024-04-15T23:35:06.093486+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.543464+0000","last_became_peered":"2024-04-15T23:32:11.543464+0000","last_unstale":"2024-04-15T23:35:06.093486+0000","last_undegraded":"2024-04-15T23:33:01.579673+0000","last_fullsized":"2024-04-15T23:32:11.540108+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297712+0000","last_change":"2024-04-15T23:35:07.919852+0000","last_active":"2024-04-15T23:35:13.297712+0000","last_peered":"2024-04-15T23:35:13.297712+0000","last_clean":"2024-04-15T23:35:13.297712+0000","last_became_active":"2024-04-15T23:35:07.919642+0000","last_became_peered":"2024-04-15T23:35:07.919642+0000","last_unstale":"2024-04-15T23:35:13.297712+0000","last_undegraded":"2024-04-15T23:35:13.297712+0000","last_fullsized":"2024-04-15T23:35:13.297712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:29.682287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298313+0000","last_change":"2024-04-15T23:35:07.923775+0000","last_active":"2024-04-15T23:35:13.298313+0000","last_peered":"2024-04-15T23:35:13.298313+0000","last_clean":"2024-04-15T23:35:13.298313+0000","last_became_active":"2024-04-15T23:35:07.923310+0000","last_became_peered":"2024-04-15T23:35:07.923310+0000","last_unstale":"2024-04-15T23:35:13.298313+0000","last_undegraded":"2024-04-15T23:35:13.298313+0000","last_fullsized":"2024-04-15T23:35:13.298313+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:44.456832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":231,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092917+0000","last_change":"2024-04-15T23:35:07.901562+0000","last_active":"2024-04-15T23:35:07.901562+0000","last_peered":"2024-04-15T23:35:06.092917+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542992+0000","last_became_peered":"2024-04-15T23:32:11.542992+0000","last_unstale":"2024-04-15T23:35:06.092917+0000","last_undegraded":"2024-04-15T23:33:04.175963+0000","last_fullsized":"2024-04-15T23:32:11.540105+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298232+0000","last_change":"2024-04-15T23:35:07.919638+0000","last_active":"2024-04-15T23:35:13.298232+0000","last_peered":"2024-04-15T23:35:13.298232+0000","last_clean":"2024-04-15T23:35:13.298232+0000","last_became_active":"2024-04-15T23:35:07.919325+0000","last_became_peered":"2024-04-15T23:35:07.919325+0000","last_unstale":"2024-04-15T23:35:13.298232+0000","last_undegraded":"2024-04-15T23:35:13.298232+0000","last_fullsized":"2024-04-15T23:35:13.298232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:20.779700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291371+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:35:10.291371+0000","last_peered":"2024-04-15T23:35:10.291371+0000","last_clean":"2024-04-15T23:35:10.291371+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:35:10.291371+0000","last_undegraded":"2024-04-15T23:35:10.291371+0000","last_fullsized":"2024-04-15T23:35:10.291371+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":324,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291509+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:35:10.291509+0000","last_peered":"2024-04-15T23:35:10.291509+0000","last_clean":"2024-04-15T23:35:10.291509+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:35:10.291509+0000","last_undegraded":"2024-04-15T23:35:10.291509+0000","last_fullsized":"2024-04-15T23:35:10.291509+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295958+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:35:13.295958+0000","last_peered":"2024-04-15T23:35:13.295958+0000","last_clean":"2024-04-15T23:35:13.295958+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:35:13.295958+0000","last_undegraded":"2024-04-15T23:35:13.295958+0000","last_fullsized":"2024-04-15T23:35:13.295958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":293,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295538+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:35:13.295538+0000","last_peered":"2024-04-15T23:35:13.295538+0000","last_clean":"2024-04-15T23:35:13.295538+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:35:13.295538+0000","last_undegraded":"2024-04-15T23:35:13.295538+0000","last_fullsized":"2024-04-15T23:35:13.295538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":30,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292195+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:35:10.292195+0000","last_peered":"2024-04-15T23:35:10.292195+0000","last_clean":"2024-04-15T23:35:10.292195+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:35:10.292195+0000","last_undegraded":"2024-04-15T23:35:10.292195+0000","last_fullsized":"2024-04-15T23:35:10.292195+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291681+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:35:10.291681+0000","last_peered":"2024-04-15T23:35:10.291681+0000","last_clean":"2024-04-15T23:35:10.291681+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:35:10.291681+0000","last_undegraded":"2024-04-15T23:35:10.291681+0000","last_fullsized":"2024-04-15T23:35:10.291681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":229,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:05.895269+0000","last_change":"2024-04-15T23:35:07.899081+0000","last_active":"2024-04-15T23:35:07.899081+0000","last_peered":"2024-04-15T23:35:05.895269+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.544726+0000","last_became_peered":"2024-04-15T23:32:11.544726+0000","last_unstale":"2024-04-15T23:35:05.895269+0000","last_undegraded":"2024-04-15T23:33:01.573690+0000","last_fullsized":"2024-04-15T23:32:11.542306+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":45,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.291688+0000","last_change":"2024-04-15T23:35:07.961077+0000","last_active":"2024-04-15T23:35:10.291688+0000","last_peered":"2024-04-15T23:35:10.291688+0000","last_clean":"2024-04-15T23:35:10.291688+0000","last_became_active":"2024-04-15T23:35:07.924404+0000","last_became_peered":"2024-04-15T23:35:07.924404+0000","last_unstale":"2024-04-15T23:35:10.291688+0000","last_undegraded":"2024-04-15T23:35:10.291688+0000","last_fullsized":"2024-04-15T23:35:10.291688+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:26.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298355+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:35:13.298355+0000","last_peered":"2024-04-15T23:35:13.298355+0000","last_clean":"2024-04-15T23:35:13.298355+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:35:13.298355+0000","last_undegraded":"2024-04-15T23:35:13.298355+0000","last_fullsized":"2024-04-15T23:35:13.298355+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":255,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294755+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:35:13.294755+0000","last_peered":"2024-04-15T23:35:13.294755+0000","last_clean":"2024-04-15T23:35:13.294755+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:35:13.294755+0000","last_undegraded":"2024-04-15T23:35:13.294755+0000","last_fullsized":"2024-04-15T23:35:13.294755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":268,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298037+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:35:13.298037+0000","last_peered":"2024-04-15T23:35:13.298037+0000","last_clean":"2024-04-15T23:35:13.298037+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:35:13.298037+0000","last_undegraded":"2024-04-15T23:35:13.298037+0000","last_fullsized":"2024-04-15T23:35:13.298037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":158,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298319+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:35:13.298319+0000","last_peered":"2024-04-15T23:35:13.298319+0000","last_clean":"2024-04-15T23:35:13.298319+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:35:13.298319+0000","last_undegraded":"2024-04-15T23:35:13.298319+0000","last_fullsized":"2024-04-15T23:35:13.298319+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":221,"reported_epoch":57,"state":"remapped+peering","last_fresh":"2024-04-15T23:35:06.092804+0000","last_change":"2024-04-15T23:35:07.901573+0000","last_active":"2024-04-15T23:35:07.901573+0000","last_peered":"2024-04-15T23:35:06.092804+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.542068+0000","last_became_peered":"2024-04-15T23:32:11.542068+0000","last_unstale":"2024-04-15T23:35:06.092804+0000","last_undegraded":"2024-04-15T23:33:04.225125+0000","last_fullsized":"2024-04-15T23:32:11.539597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":138,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295649+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:35:13.295649+0000","last_peered":"2024-04-15T23:35:13.295649+0000","last_clean":"2024-04-15T23:35:13.295649+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:35:13.295649+0000","last_undegraded":"2024-04-15T23:35:13.295649+0000","last_fullsized":"2024-04-15T23:35:13.295649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298732+0000","last_change":"2024-04-15T23:35:07.923603+0000","last_active":"2024-04-15T23:35:13.298732+0000","last_peered":"2024-04-15T23:35:13.298732+0000","last_clean":"2024-04-15T23:35:13.298732+0000","last_became_active":"2024-04-15T23:35:07.923069+0000","last_became_peered":"2024-04-15T23:35:07.923069+0000","last_unstale":"2024-04-15T23:35:13.298732+0000","last_undegraded":"2024-04-15T23:35:13.298732+0000","last_fullsized":"2024-04-15T23:35:13.298732+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:39.536190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":257,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.295722+0000","last_change":"2024-04-15T23:35:10.295722+0000","last_active":"2024-04-15T23:35:10.295722+0000","last_peered":"2024-04-15T23:35:10.295722+0000","last_clean":"2024-04-15T23:35:10.295722+0000","last_became_active":"2024-04-15T23:35:10.294673+0000","last_became_peered":"2024-04-15T23:35:10.294673+0000","last_unstale":"2024-04-15T23:35:10.295722+0000","last_undegraded":"2024-04-15T23:35:10.295722+0000","last_fullsized":"2024-04-15T23:35:10.295722+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:19.610009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292274+0000","last_change":"2024-04-15T23:35:07.923646+0000","last_active":"2024-04-15T23:35:10.292274+0000","last_peered":"2024-04-15T23:35:10.292274+0000","last_clean":"2024-04-15T23:35:10.292274+0000","last_became_active":"2024-04-15T23:35:07.923298+0000","last_became_peered":"2024-04-15T23:35:07.923298+0000","last_unstale":"2024-04-15T23:35:10.292274+0000","last_undegraded":"2024-04-15T23:35:10.292274+0000","last_fullsized":"2024-04-15T23:35:10.292274+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:01.524255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":244,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.302738+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:35:10.302738+0000","last_peered":"2024-04-15T23:35:10.302738+0000","last_clean":"2024-04-15T23:35:10.302738+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:35:10.302738+0000","last_undegraded":"2024-04-15T23:35:10.302738+0000","last_fullsized":"2024-04-15T23:35:10.302738+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":284,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296397+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:35:13.296397+0000","last_peered":"2024-04-15T23:35:13.296397+0000","last_clean":"2024-04-15T23:35:13.296397+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:35:13.296397+0000","last_undegraded":"2024-04-15T23:35:13.296397+0000","last_fullsized":"2024-04-15T23:35:13.296397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290687+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:35:10.290687+0000","last_peered":"2024-04-15T23:35:10.290687+0000","last_clean":"2024-04-15T23:35:10.290687+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:35:10.290687+0000","last_undegraded":"2024-04-15T23:35:10.290687+0000","last_fullsized":"2024-04-15T23:35:10.290687+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":247,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.297911+0000","last_change":"2024-04-15T23:35:08.969134+0000","last_active":"2024-04-15T23:35:13.297911+0000","last_peered":"2024-04-15T23:35:13.297911+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:35:08.968186+0000","last_became_peered":"2024-04-15T23:35:08.968186+0000","last_unstale":"2024-04-15T23:35:13.297911+0000","last_undegraded":"2024-04-15T23:35:08.910804+0000","last_fullsized":"2024-04-15T23:35:08.906885+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":99,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":47}],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.290735+0000","last_change":"2024-04-15T23:35:07.917897+0000","last_active":"2024-04-15T23:35:10.290735+0000","last_peered":"2024-04-15T23:35:10.290735+0000","last_clean":"2024-04-15T23:35:10.290735+0000","last_became_active":"2024-04-15T23:35:07.917508+0000","last_became_peered":"2024-04-15T23:35:07.917508+0000","last_unstale":"2024-04-15T23:35:10.290735+0000","last_undegraded":"2024-04-15T23:35:10.290735+0000","last_fullsized":"2024-04-15T23:35:10.290735+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:41:58.784211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":261,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295243+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:35:13.295243+0000","last_peered":"2024-04-15T23:35:13.295243+0000","last_clean":"2024-04-15T23:35:13.295243+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:35:13.295243+0000","last_undegraded":"2024-04-15T23:35:13.295243+0000","last_fullsized":"2024-04-15T23:35:13.295243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":129,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295114+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:35:13.295114+0000","last_peered":"2024-04-15T23:35:13.295114+0000","last_clean":"2024-04-15T23:35:13.295114+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:35:13.295114+0000","last_undegraded":"2024-04-15T23:35:13.295114+0000","last_fullsized":"2024-04-15T23:35:13.295114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":492,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298781+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:35:13.298781+0000","last_peered":"2024-04-15T23:35:13.298781+0000","last_clean":"2024-04-15T23:35:13.298781+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:35:13.298781+0000","last_undegraded":"2024-04-15T23:35:13.298781+0000","last_fullsized":"2024-04-15T23:35:13.298781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":120,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295938+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:35:13.295938+0000","last_peered":"2024-04-15T23:35:13.295938+0000","last_clean":"2024-04-15T23:35:13.295938+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:35:13.295938+0000","last_undegraded":"2024-04-15T23:35:13.295938+0000","last_fullsized":"2024-04-15T23:35:13.295938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":485,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.971968+0000","last_change":"2024-04-15T23:35:13.297688+0000","last_active":"2024-04-15T23:35:13.297688+0000","last_peered":"2024-04-15T23:35:12.971968+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:35:08.966050+0000","last_became_peered":"2024-04-15T23:35:08.966050+0000","last_unstale":"2024-04-15T23:35:12.971968+0000","last_undegraded":"2024-04-15T23:35:12.971968+0000","last_fullsized":"2024-04-15T23:35:08.903476+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":111927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":124,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298247+0000","last_change":"2024-04-15T23:35:07.923605+0000","last_active":"2024-04-15T23:35:13.298247+0000","last_peered":"2024-04-15T23:35:13.298247+0000","last_clean":"2024-04-15T23:35:13.298247+0000","last_became_active":"2024-04-15T23:35:07.923048+0000","last_became_peered":"2024-04-15T23:35:07.923048+0000","last_unstale":"2024-04-15T23:35:13.298247+0000","last_undegraded":"2024-04-15T23:35:13.298247+0000","last_fullsized":"2024-04-15T23:35:13.298247+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:24.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":485,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297455+0000","last_change":"2024-04-15T23:35:12.299637+0000","last_active":"2024-04-15T23:35:13.297455+0000","last_peered":"2024-04-15T23:35:13.297455+0000","last_clean":"2024-04-15T23:35:13.297455+0000","last_became_active":"2024-04-15T23:35:12.298564+0000","last_became_peered":"2024-04-15T23:35:12.298564+0000","last_unstale":"2024-04-15T23:35:13.297455+0000","last_undegraded":"2024-04-15T23:35:13.297455+0000","last_fullsized":"2024-04-15T23:35:13.297455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:45:24.200208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":173945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":174,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295496+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:35:13.295496+0000","last_peered":"2024-04-15T23:35:13.295496+0000","last_clean":"2024-04-15T23:35:13.295496+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:35:13.295496+0000","last_undegraded":"2024-04-15T23:35:13.295496+0000","last_fullsized":"2024-04-15T23:35:13.295496+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":503,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294987+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:35:13.294987+0000","last_peered":"2024-04-15T23:35:13.294987+0000","last_clean":"2024-04-15T23:35:13.294987+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:35:13.294987+0000","last_undegraded":"2024-04-15T23:35:13.294987+0000","last_fullsized":"2024-04-15T23:35:13.294987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292005+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:35:10.292005+0000","last_peered":"2024-04-15T23:35:10.292005+0000","last_clean":"2024-04-15T23:35:10.292005+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:35:10.292005+0000","last_undegraded":"2024-04-15T23:35:10.292005+0000","last_fullsized":"2024-04-15T23:35:10.292005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":555,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297703+0000","last_change":"2024-04-15T23:35:12.299365+0000","last_active":"2024-04-15T23:35:13.297703+0000","last_peered":"2024-04-15T23:35:13.297703+0000","last_clean":"2024-04-15T23:35:13.297703+0000","last_became_active":"2024-04-15T23:35:12.298555+0000","last_became_peered":"2024-04-15T23:35:12.298555+0000","last_unstale":"2024-04-15T23:35:13.297703+0000","last_undegraded":"2024-04-15T23:35:13.297703+0000","last_fullsized":"2024-04-15T23:35:13.297703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:43:56.403627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":134131,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":34,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-15T23:35:10.292065+0000","last_change":"2024-04-15T23:35:07.956652+0000","last_active":"2024-04-15T23:35:10.292065+0000","last_peered":"2024-04-15T23:35:10.292065+0000","last_clean":"2024-04-15T23:35:10.292065+0000","last_became_active":"2024-04-15T23:35:07.923145+0000","last_became_peered":"2024-04-15T23:35:07.923145+0000","last_unstale":"2024-04-15T23:35:10.292065+0000","last_undegraded":"2024-04-15T23:35:10.292065+0000","last_fullsized":"2024-04-15T23:35:10.292065+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:50:11.946892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":732,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3004,"num_bytes_recovered":10971990,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53833728,"data_stored":38400819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":107,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20623652,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103170,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54736,"kb_used_data":23040,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94317104,"statfs":{"total":96636764160,"available":96580714496,"internally_reserved":0,"allocated":23592960,"data_stored":22021809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":32433383},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83832,"kb_used_data":52652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94288008,"statfs":{"total":96636764160,"available":96550920192,"internally_reserved":0,"allocated":53915648,"data_stored":47013869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88812,"kb_used_data":57632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283028,"statfs":{"total":96636764160,"available":96545820672,"internally_reserved":0,"allocated":59015168,"data_stored":52117292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19513344,"data_stored":12945571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5849088,"data_stored":3559202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:35:17.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:35:17.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:17.964 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:35:17.972 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-04-15T23:35:17.828049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":308,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4024,"num_bytes_recovered":33563334,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257948,"kb_used_data":155576,"kb_used_omap":9,"kb_used_meta":102326,"kb_avail":282857572,"statfs":{"total":289910292480,"available":289646153728,"internally_reserved":0,"allocated":159309824,"data_stored":138149153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":104781937},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":308,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3583,"num_bytes_recovered":16024588,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534759"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":476,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.299821+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:35:13.299821+0000","last_peered":"2024-04-15T23:35:13.299821+0000","last_clean":"2024-04-15T23:35:13.299821+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:35:13.299821+0000","last_undegraded":"2024-04-15T23:35:13.299821+0000","last_fullsized":"2024-04-15T23:35:13.299821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":446,"reported_epoch":65,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-15T23:35:13.855054+0000","last_change":"2024-04-15T23:35:13.836134+0000","last_active":"2024-04-15T23:35:13.855054+0000","last_peered":"2024-04-15T23:35:13.855054+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:35:08.966346+0000","last_became_peered":"2024-04-15T23:35:08.966346+0000","last_unstale":"2024-04-15T23:35:13.855054+0000","last_undegraded":"2024-04-15T23:35:13.855054+0000","last_fullsized":"2024-04-15T23:35:08.902876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":282,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297704+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:35:13.297704+0000","last_peered":"2024-04-15T23:35:13.297704+0000","last_clean":"2024-04-15T23:35:13.297704+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:35:13.297704+0000","last_undegraded":"2024-04-15T23:35:13.297704+0000","last_fullsized":"2024-04-15T23:35:13.297704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":414,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.467475+0000","last_change":"2024-04-15T23:35:13.297397+0000","last_active":"2024-04-15T23:35:13.297397+0000","last_peered":"2024-04-15T23:35:12.467475+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:35:08.964645+0000","last_became_peered":"2024-04-15T23:35:08.964645+0000","last_unstale":"2024-04-15T23:35:12.467475+0000","last_undegraded":"2024-04-15T23:35:12.467475+0000","last_fullsized":"2024-04-15T23:35:08.904509+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":139423,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":290,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295640+0000","last_change":"2024-04-15T23:35:08.967663+0000","last_active":"2024-04-15T23:35:13.295640+0000","last_peered":"2024-04-15T23:35:13.295640+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:35:08.966945+0000","last_became_peered":"2024-04-15T23:35:08.966945+0000","last_unstale":"2024-04-15T23:35:13.295640+0000","last_undegraded":"2024-04-15T23:35:08.906099+0000","last_fullsized":"2024-04-15T23:35:08.904502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":73}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":513,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.303626+0000","last_change":"2024-04-15T23:35:13.303626+0000","last_active":"2024-04-15T23:35:13.303626+0000","last_peered":"2024-04-15T23:35:13.303626+0000","last_clean":"2024-04-15T23:35:13.303626+0000","last_became_active":"2024-04-15T23:35:13.303020+0000","last_became_peered":"2024-04-15T23:35:13.303020+0000","last_unstale":"2024-04-15T23:35:13.303626+0000","last_undegraded":"2024-04-15T23:35:13.303626+0000","last_fullsized":"2024-04-15T23:35:13.303626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:36.526930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":182889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":508,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297253+0000","last_change":"2024-04-15T23:35:11.296974+0000","last_active":"2024-04-15T23:35:13.297253+0000","last_peered":"2024-04-15T23:35:13.297253+0000","last_clean":"2024-04-15T23:35:13.297253+0000","last_became_active":"2024-04-15T23:35:11.296148+0000","last_became_peered":"2024-04-15T23:35:11.296148+0000","last_unstale":"2024-04-15T23:35:13.297253+0000","last_undegraded":"2024-04-15T23:35:13.297253+0000","last_fullsized":"2024-04-15T23:35:13.297253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:54:02.940157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":274228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":439,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297508+0000","last_change":"2024-04-15T23:35:12.299337+0000","last_active":"2024-04-15T23:35:13.297508+0000","last_peered":"2024-04-15T23:35:13.297508+0000","last_clean":"2024-04-15T23:35:13.297508+0000","last_became_active":"2024-04-15T23:35:12.298132+0000","last_became_peered":"2024-04-15T23:35:12.298132+0000","last_unstale":"2024-04-15T23:35:13.297508+0000","last_undegraded":"2024-04-15T23:35:13.297508+0000","last_fullsized":"2024-04-15T23:35:13.297508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:56:07.706157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":98254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293143+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:35:15.293143+0000","last_peered":"2024-04-15T23:35:15.293143+0000","last_clean":"2024-04-15T23:35:15.293143+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:35:15.293143+0000","last_undegraded":"2024-04-15T23:35:15.293143+0000","last_fullsized":"2024-04-15T23:35:15.293143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":269,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295221+0000","last_change":"2024-04-15T23:35:08.968933+0000","last_active":"2024-04-15T23:35:13.295221+0000","last_peered":"2024-04-15T23:35:13.295221+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:35:08.968156+0000","last_became_peered":"2024-04-15T23:35:08.968156+0000","last_unstale":"2024-04-15T23:35:13.295221+0000","last_undegraded":"2024-04-15T23:35:08.907306+0000","last_fullsized":"2024-04-15T23:35:08.904735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":52}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":477,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297805+0000","last_change":"2024-04-15T23:35:10.294609+0000","last_active":"2024-04-15T23:35:13.297805+0000","last_peered":"2024-04-15T23:35:13.297805+0000","last_clean":"2024-04-15T23:35:13.297805+0000","last_became_active":"2024-04-15T23:35:10.294222+0000","last_became_peered":"2024-04-15T23:35:10.294222+0000","last_unstale":"2024-04-15T23:35:13.297805+0000","last_undegraded":"2024-04-15T23:35:13.297805+0000","last_fullsized":"2024-04-15T23:35:13.297805+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":192323,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":254,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":427,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:13.093403+0000","last_change":"2024-04-15T23:35:13.296237+0000","last_active":"2024-04-15T23:35:13.296237+0000","last_peered":"2024-04-15T23:35:13.093403+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:35:08.965939+0000","last_became_peered":"2024-04-15T23:35:08.965939+0000","last_unstale":"2024-04-15T23:35:13.093403+0000","last_undegraded":"2024-04-15T23:35:13.093403+0000","last_fullsized":"2024-04-15T23:35:08.902173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":290,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297258+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:35:13.297258+0000","last_peered":"2024-04-15T23:35:13.297258+0000","last_clean":"2024-04-15T23:35:13.297258+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:35:13.297258+0000","last_undegraded":"2024-04-15T23:35:13.297258+0000","last_fullsized":"2024-04-15T23:35:13.297258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":270,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297273+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:35:13.297273+0000","last_peered":"2024-04-15T23:35:13.297273+0000","last_clean":"2024-04-15T23:35:13.297273+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:35:13.297273+0000","last_undegraded":"2024-04-15T23:35:13.297273+0000","last_fullsized":"2024-04-15T23:35:13.297273+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":525,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297566+0000","last_change":"2024-04-15T23:35:12.299129+0000","last_active":"2024-04-15T23:35:13.297566+0000","last_peered":"2024-04-15T23:35:13.297566+0000","last_clean":"2024-04-15T23:35:13.297566+0000","last_became_active":"2024-04-15T23:35:12.298025+0000","last_became_peered":"2024-04-15T23:35:12.298025+0000","last_unstale":"2024-04-15T23:35:13.297566+0000","last_undegraded":"2024-04-15T23:35:13.297566+0000","last_fullsized":"2024-04-15T23:35:13.297566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:08:47.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1487227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293088+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:35:15.293088+0000","last_peered":"2024-04-15T23:35:15.293088+0000","last_clean":"2024-04-15T23:35:15.293088+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:35:15.293088+0000","last_undegraded":"2024-04-15T23:35:15.293088+0000","last_fullsized":"2024-04-15T23:35:15.293088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":267,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295677+0000","last_change":"2024-04-15T23:35:08.968935+0000","last_active":"2024-04-15T23:35:13.295677+0000","last_peered":"2024-04-15T23:35:13.295677+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:35:08.968128+0000","last_became_peered":"2024-04-15T23:35:08.968128+0000","last_unstale":"2024-04-15T23:35:13.295677+0000","last_undegraded":"2024-04-15T23:35:08.909234+0000","last_fullsized":"2024-04-15T23:35:08.907780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":49}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":221,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-15T23:35:15.293210+0000","last_change":"2024-04-15T23:35:15.293210+0000","last_active":"2024-04-15T23:35:07.902727+0000","last_peered":"2024-04-15T23:35:06.093128+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:35:15.293210+0000","last_undegraded":"2024-04-15T23:35:15.293210+0000","last_fullsized":"2024-04-15T23:35:15.293210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":536,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:13.236358+0000","last_change":"2024-04-15T23:35:13.298540+0000","last_active":"2024-04-15T23:35:13.298540+0000","last_peered":"2024-04-15T23:35:13.236358+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:35:08.966005+0000","last_became_peered":"2024-04-15T23:35:08.966005+0000","last_unstale":"2024-04-15T23:35:13.236358+0000","last_undegraded":"2024-04-15T23:35:13.236358+0000","last_fullsized":"2024-04-15T23:35:08.905437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":244249,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":483,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.497678+0000","last_change":"2024-04-15T23:35:13.497831+0000","last_active":"2024-04-15T23:35:13.497678+0000","last_peered":"2024-04-15T23:35:13.497678+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:35:08.967036+0000","last_became_peered":"2024-04-15T23:35:08.967036+0000","last_unstale":"2024-04-15T23:35:13.497678+0000","last_undegraded":"2024-04-15T23:35:13.497678+0000","last_fullsized":"2024-04-15T23:35:08.907738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87443,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":54}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":283,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294885+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:35:13.294885+0000","last_peered":"2024-04-15T23:35:13.294885+0000","last_clean":"2024-04-15T23:35:13.294885+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:35:13.294885+0000","last_undegraded":"2024-04-15T23:35:13.294885+0000","last_fullsized":"2024-04-15T23:35:13.294885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292057+0000","last_change":"2024-04-15T23:35:10.294643+0000","last_active":"2024-04-15T23:35:15.292057+0000","last_peered":"2024-04-15T23:35:15.292057+0000","last_clean":"2024-04-15T23:35:15.292057+0000","last_became_active":"2024-04-15T23:35:10.293497+0000","last_became_peered":"2024-04-15T23:35:10.293497+0000","last_unstale":"2024-04-15T23:35:15.292057+0000","last_undegraded":"2024-04-15T23:35:15.292057+0000","last_fullsized":"2024-04-15T23:35:15.292057+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:12:59.503325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":499,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294682+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:35:13.294682+0000","last_peered":"2024-04-15T23:35:13.294682+0000","last_clean":"2024-04-15T23:35:13.294682+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:35:13.294682+0000","last_undegraded":"2024-04-15T23:35:13.294682+0000","last_fullsized":"2024-04-15T23:35:13.294682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":269,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296097+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:35:13.296097+0000","last_peered":"2024-04-15T23:35:13.296097+0000","last_clean":"2024-04-15T23:35:13.296097+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:35:13.296097+0000","last_undegraded":"2024-04-15T23:35:13.296097+0000","last_fullsized":"2024-04-15T23:35:13.296097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":267,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-15T23:35:15.293645+0000","last_change":"2024-04-15T23:35:15.293645+0000","last_active":"2024-04-15T23:35:07.916714+0000","last_peered":"2024-04-15T23:35:05.897597+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:35:15.293645+0000","last_undegraded":"2024-04-15T23:35:15.293645+0000","last_fullsized":"2024-04-15T23:35:15.293645+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":273,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297895+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:35:13.297895+0000","last_peered":"2024-04-15T23:35:13.297895+0000","last_clean":"2024-04-15T23:35:13.297895+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:35:13.297895+0000","last_undegraded":"2024-04-15T23:35:13.297895+0000","last_fullsized":"2024-04-15T23:35:13.297895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":264,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296281+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:35:13.296281+0000","last_peered":"2024-04-15T23:35:13.296281+0000","last_clean":"2024-04-15T23:35:13.296281+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:35:13.296281+0000","last_undegraded":"2024-04-15T23:35:13.296281+0000","last_fullsized":"2024-04-15T23:35:13.296281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":252,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.296264+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:35:15.296264+0000","last_peered":"2024-04-15T23:35:15.296264+0000","last_clean":"2024-04-15T23:35:15.296264+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:35:15.296264+0000","last_undegraded":"2024-04-15T23:35:15.296264+0000","last_fullsized":"2024-04-15T23:35:15.296264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":306,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294986+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:35:13.294986+0000","last_peered":"2024-04-15T23:35:13.294986+0000","last_clean":"2024-04-15T23:35:13.294986+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:35:13.294986+0000","last_undegraded":"2024-04-15T23:35:13.294986+0000","last_fullsized":"2024-04-15T23:35:13.294986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":281,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292422+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:35:15.292422+0000","last_peered":"2024-04-15T23:35:15.292422+0000","last_clean":"2024-04-15T23:35:15.292422+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:35:15.292422+0000","last_undegraded":"2024-04-15T23:35:15.292422+0000","last_fullsized":"2024-04-15T23:35:15.292422+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":537,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297604+0000","last_change":"2024-04-15T23:35:11.297293+0000","last_active":"2024-04-15T23:35:13.297604+0000","last_peered":"2024-04-15T23:35:13.297604+0000","last_clean":"2024-04-15T23:35:13.297604+0000","last_became_active":"2024-04-15T23:35:11.296756+0000","last_became_peered":"2024-04-15T23:35:11.296756+0000","last_unstale":"2024-04-15T23:35:13.297604+0000","last_undegraded":"2024-04-15T23:35:13.297604+0000","last_fullsized":"2024-04-15T23:35:13.297604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:58:45.896248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":127328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":457,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.577377+0000","last_change":"2024-04-15T23:35:13.296053+0000","last_active":"2024-04-15T23:35:13.296053+0000","last_peered":"2024-04-15T23:35:12.577377+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:35:08.965317+0000","last_became_peered":"2024-04-15T23:35:08.965317+0000","last_unstale":"2024-04-15T23:35:12.577377+0000","last_undegraded":"2024-04-15T23:35:12.577377+0000","last_fullsized":"2024-04-15T23:35:08.906044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298212+0000","last_change":"2024-04-15T23:35:10.294028+0000","last_active":"2024-04-15T23:35:13.298212+0000","last_peered":"2024-04-15T23:35:13.298212+0000","last_clean":"2024-04-15T23:35:13.298212+0000","last_became_active":"2024-04-15T23:35:10.293804+0000","last_became_peered":"2024-04-15T23:35:10.293804+0000","last_unstale":"2024-04-15T23:35:13.298212+0000","last_undegraded":"2024-04-15T23:35:13.298212+0000","last_fullsized":"2024-04-15T23:35:13.298212+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:14.050412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3518792,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":462,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295398+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:35:13.295398+0000","last_peered":"2024-04-15T23:35:13.295398+0000","last_clean":"2024-04-15T23:35:13.295398+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:35:13.295398+0000","last_undegraded":"2024-04-15T23:35:13.295398+0000","last_fullsized":"2024-04-15T23:35:13.295398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292113+0000","last_change":"2024-04-15T23:35:07.923327+0000","last_active":"2024-04-15T23:35:15.292113+0000","last_peered":"2024-04-15T23:35:15.292113+0000","last_clean":"2024-04-15T23:35:15.292113+0000","last_became_active":"2024-04-15T23:35:07.923022+0000","last_became_peered":"2024-04-15T23:35:07.923022+0000","last_unstale":"2024-04-15T23:35:15.292113+0000","last_undegraded":"2024-04-15T23:35:15.292113+0000","last_fullsized":"2024-04-15T23:35:15.292113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:56.197588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":277,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.296797+0000","last_change":"2024-04-15T23:35:15.296797+0000","last_active":"2024-04-15T23:35:15.296797+0000","last_peered":"2024-04-15T23:35:15.296797+0000","last_clean":"2024-04-15T23:35:15.296797+0000","last_became_active":"2024-04-15T23:35:15.295475+0000","last_became_peered":"2024-04-15T23:35:15.295475+0000","last_unstale":"2024-04-15T23:35:15.296797+0000","last_undegraded":"2024-04-15T23:35:15.296797+0000","last_fullsized":"2024-04-15T23:35:15.296797+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:57:52.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294857+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:35:13.294857+0000","last_peered":"2024-04-15T23:35:13.294857+0000","last_clean":"2024-04-15T23:35:13.294857+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:35:13.294857+0000","last_undegraded":"2024-04-15T23:35:13.294857+0000","last_fullsized":"2024-04-15T23:35:13.294857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":267,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292713+0000","last_change":"2024-04-15T23:35:13.304246+0000","last_active":"2024-04-15T23:35:15.292713+0000","last_peered":"2024-04-15T23:35:15.292713+0000","last_clean":"2024-04-15T23:35:15.292713+0000","last_became_active":"2024-04-15T23:35:13.303224+0000","last_became_peered":"2024-04-15T23:35:13.303224+0000","last_unstale":"2024-04-15T23:35:15.292713+0000","last_undegraded":"2024-04-15T23:35:15.292713+0000","last_fullsized":"2024-04-15T23:35:15.292713+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:12.292741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":124,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297842+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:35:13.297842+0000","last_peered":"2024-04-15T23:35:13.297842+0000","last_clean":"2024-04-15T23:35:13.297842+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:35:13.297842+0000","last_undegraded":"2024-04-15T23:35:13.297842+0000","last_fullsized":"2024-04-15T23:35:13.297842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":116,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298229+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:35:13.298229+0000","last_peered":"2024-04-15T23:35:13.298229+0000","last_clean":"2024-04-15T23:35:13.298229+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:35:13.298229+0000","last_undegraded":"2024-04-15T23:35:13.298229+0000","last_fullsized":"2024-04-15T23:35:13.298229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":266,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294692+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:35:13.294692+0000","last_peered":"2024-04-15T23:35:13.294692+0000","last_clean":"2024-04-15T23:35:13.294692+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:35:13.294692+0000","last_undegraded":"2024-04-15T23:35:13.294692+0000","last_fullsized":"2024-04-15T23:35:13.294692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":118,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295849+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:35:13.295849+0000","last_peered":"2024-04-15T23:35:13.295849+0000","last_clean":"2024-04-15T23:35:13.295849+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:35:13.295849+0000","last_undegraded":"2024-04-15T23:35:13.295849+0000","last_fullsized":"2024-04-15T23:35:13.295849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":536,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294757+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:35:13.294757+0000","last_peered":"2024-04-15T23:35:13.294757+0000","last_clean":"2024-04-15T23:35:13.294757+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:35:13.294757+0000","last_undegraded":"2024-04-15T23:35:13.294757+0000","last_fullsized":"2024-04-15T23:35:13.294757+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":116,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298172+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:35:13.298172+0000","last_peered":"2024-04-15T23:35:13.298172+0000","last_clean":"2024-04-15T23:35:13.298172+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:35:13.298172+0000","last_undegraded":"2024-04-15T23:35:13.298172+0000","last_fullsized":"2024-04-15T23:35:13.298172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":467,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.300527+0000","last_change":"2024-04-15T23:35:13.300527+0000","last_active":"2024-04-15T23:35:13.300527+0000","last_peered":"2024-04-15T23:35:13.300527+0000","last_clean":"2024-04-15T23:35:13.300527+0000","last_became_active":"2024-04-15T23:35:13.300095+0000","last_became_peered":"2024-04-15T23:35:13.300095+0000","last_unstale":"2024-04-15T23:35:13.300527+0000","last_undegraded":"2024-04-15T23:35:13.300527+0000","last_fullsized":"2024-04-15T23:35:13.300527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:44.585807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":66508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":123,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298559+0000","last_change":"2024-04-15T23:35:07.923940+0000","last_active":"2024-04-15T23:35:13.298559+0000","last_peered":"2024-04-15T23:35:13.298559+0000","last_clean":"2024-04-15T23:35:13.298559+0000","last_became_active":"2024-04-15T23:35:07.923559+0000","last_became_peered":"2024-04-15T23:35:07.923559+0000","last_unstale":"2024-04-15T23:35:13.298559+0000","last_undegraded":"2024-04-15T23:35:13.298559+0000","last_fullsized":"2024-04-15T23:35:13.298559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:34.992257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":243,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292966+0000","last_change":"2024-04-15T23:35:14.303298+0000","last_active":"2024-04-15T23:35:15.292966+0000","last_peered":"2024-04-15T23:35:15.292966+0000","last_clean":"2024-04-15T23:35:15.292966+0000","last_became_active":"2024-04-15T23:35:14.302372+0000","last_became_peered":"2024-04-15T23:35:14.302372+0000","last_unstale":"2024-04-15T23:35:15.292966+0000","last_undegraded":"2024-04-15T23:35:15.292966+0000","last_fullsized":"2024-04-15T23:35:15.292966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:27.003926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292609+0000","last_change":"2024-04-15T23:35:07.979404+0000","last_active":"2024-04-15T23:35:15.292609+0000","last_peered":"2024-04-15T23:35:15.292609+0000","last_clean":"2024-04-15T23:35:15.292609+0000","last_became_active":"2024-04-15T23:35:07.924742+0000","last_became_peered":"2024-04-15T23:35:07.924742+0000","last_unstale":"2024-04-15T23:35:15.292609+0000","last_undegraded":"2024-04-15T23:35:15.292609+0000","last_fullsized":"2024-04-15T23:35:15.292609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:59.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":529,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.748974+0000","last_change":"2024-04-15T23:35:13.749125+0000","last_active":"2024-04-15T23:35:13.748974+0000","last_peered":"2024-04-15T23:35:13.748974+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:35:08.968016+0000","last_became_peered":"2024-04-15T23:35:08.968016+0000","last_unstale":"2024-04-15T23:35:13.748974+0000","last_undegraded":"2024-04-15T23:35:13.748974+0000","last_fullsized":"2024-04-15T23:35:08.909140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":91970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297486+0000","last_change":"2024-04-15T23:35:07.919642+0000","last_active":"2024-04-15T23:35:13.297486+0000","last_peered":"2024-04-15T23:35:13.297486+0000","last_clean":"2024-04-15T23:35:13.297486+0000","last_became_active":"2024-04-15T23:35:07.919354+0000","last_became_peered":"2024-04-15T23:35:07.919354+0000","last_unstale":"2024-04-15T23:35:13.297486+0000","last_undegraded":"2024-04-15T23:35:13.297486+0000","last_fullsized":"2024-04-15T23:35:13.297486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:24.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":279,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298064+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:35:13.298064+0000","last_peered":"2024-04-15T23:35:13.298064+0000","last_clean":"2024-04-15T23:35:13.298064+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:35:13.298064+0000","last_undegraded":"2024-04-15T23:35:13.298064+0000","last_fullsized":"2024-04-15T23:35:13.298064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":251,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298638+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:35:13.298638+0000","last_peered":"2024-04-15T23:35:13.298638+0000","last_clean":"2024-04-15T23:35:13.298638+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:35:13.298638+0000","last_undegraded":"2024-04-15T23:35:13.298638+0000","last_fullsized":"2024-04-15T23:35:13.298638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":123,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294792+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:35:13.294792+0000","last_peered":"2024-04-15T23:35:13.294792+0000","last_clean":"2024-04-15T23:35:13.294792+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:35:13.294792+0000","last_undegraded":"2024-04-15T23:35:13.294792+0000","last_fullsized":"2024-04-15T23:35:13.294792+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":234,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293356+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:35:15.293356+0000","last_peered":"2024-04-15T23:35:15.293356+0000","last_clean":"2024-04-15T23:35:15.293356+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:35:15.293356+0000","last_undegraded":"2024-04-15T23:35:15.293356+0000","last_fullsized":"2024-04-15T23:35:15.293356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":317,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297884+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:35:13.297884+0000","last_peered":"2024-04-15T23:35:13.297884+0000","last_clean":"2024-04-15T23:35:13.297884+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:35:13.297884+0000","last_undegraded":"2024-04-15T23:35:13.297884+0000","last_fullsized":"2024-04-15T23:35:13.297884+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298552+0000","last_change":"2024-04-15T23:35:07.919572+0000","last_active":"2024-04-15T23:35:13.298552+0000","last_peered":"2024-04-15T23:35:13.298552+0000","last_clean":"2024-04-15T23:35:13.298552+0000","last_became_active":"2024-04-15T23:35:07.919258+0000","last_became_peered":"2024-04-15T23:35:07.919258+0000","last_unstale":"2024-04-15T23:35:13.298552+0000","last_undegraded":"2024-04-15T23:35:13.298552+0000","last_fullsized":"2024-04-15T23:35:13.298552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:56.248931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292277+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:35:15.292277+0000","last_peered":"2024-04-15T23:35:15.292277+0000","last_clean":"2024-04-15T23:35:15.292277+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:35:15.292277+0000","last_undegraded":"2024-04-15T23:35:15.292277+0000","last_fullsized":"2024-04-15T23:35:15.292277+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":264,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298128+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:35:13.298128+0000","last_peered":"2024-04-15T23:35:13.298128+0000","last_clean":"2024-04-15T23:35:13.298128+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:35:13.298128+0000","last_undegraded":"2024-04-15T23:35:13.298128+0000","last_fullsized":"2024-04-15T23:35:13.298128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297801+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:35:13.297801+0000","last_peered":"2024-04-15T23:35:13.297801+0000","last_clean":"2024-04-15T23:35:13.297801+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:35:13.297801+0000","last_undegraded":"2024-04-15T23:35:13.297801+0000","last_fullsized":"2024-04-15T23:35:13.297801+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292017+0000","last_change":"2024-04-15T23:35:07.935306+0000","last_active":"2024-04-15T23:35:15.292017+0000","last_peered":"2024-04-15T23:35:15.292017+0000","last_clean":"2024-04-15T23:35:15.292017+0000","last_became_active":"2024-04-15T23:35:07.919625+0000","last_became_peered":"2024-04-15T23:35:07.919625+0000","last_unstale":"2024-04-15T23:35:15.292017+0000","last_undegraded":"2024-04-15T23:35:15.292017+0000","last_fullsized":"2024-04-15T23:35:15.292017+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:49:44.043170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":486,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.620762+0000","last_change":"2024-04-15T23:35:13.620914+0000","last_active":"2024-04-15T23:35:13.620762+0000","last_peered":"2024-04-15T23:35:13.620762+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:35:08.966327+0000","last_became_peered":"2024-04-15T23:35:08.966327+0000","last_unstale":"2024-04-15T23:35:13.620762+0000","last_undegraded":"2024-04-15T23:35:08.907357+0000","last_fullsized":"2024-04-15T23:35:08.904728+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":57}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292251+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:35:15.292251+0000","last_peered":"2024-04-15T23:35:15.292251+0000","last_clean":"2024-04-15T23:35:15.292251+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:35:15.292251+0000","last_undegraded":"2024-04-15T23:35:15.292251+0000","last_fullsized":"2024-04-15T23:35:15.292251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294825+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:35:13.294825+0000","last_peered":"2024-04-15T23:35:13.294825+0000","last_clean":"2024-04-15T23:35:13.294825+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:35:13.294825+0000","last_undegraded":"2024-04-15T23:35:13.294825+0000","last_fullsized":"2024-04-15T23:35:13.294825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":255,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293358+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:35:15.293358+0000","last_peered":"2024-04-15T23:35:15.293358+0000","last_clean":"2024-04-15T23:35:15.293358+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:35:15.293358+0000","last_undegraded":"2024-04-15T23:35:15.293358+0000","last_fullsized":"2024-04-15T23:35:15.293358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297712+0000","last_change":"2024-04-15T23:35:07.919852+0000","last_active":"2024-04-15T23:35:13.297712+0000","last_peered":"2024-04-15T23:35:13.297712+0000","last_clean":"2024-04-15T23:35:13.297712+0000","last_became_active":"2024-04-15T23:35:07.919642+0000","last_became_peered":"2024-04-15T23:35:07.919642+0000","last_unstale":"2024-04-15T23:35:13.297712+0000","last_undegraded":"2024-04-15T23:35:13.297712+0000","last_fullsized":"2024-04-15T23:35:13.297712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:29.682287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298313+0000","last_change":"2024-04-15T23:35:07.923775+0000","last_active":"2024-04-15T23:35:13.298313+0000","last_peered":"2024-04-15T23:35:13.298313+0000","last_clean":"2024-04-15T23:35:13.298313+0000","last_became_active":"2024-04-15T23:35:07.923310+0000","last_became_peered":"2024-04-15T23:35:07.923310+0000","last_unstale":"2024-04-15T23:35:13.298313+0000","last_undegraded":"2024-04-15T23:35:13.298313+0000","last_fullsized":"2024-04-15T23:35:13.298313+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:44.456832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":244,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292419+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:35:15.292419+0000","last_peered":"2024-04-15T23:35:15.292419+0000","last_clean":"2024-04-15T23:35:15.292419+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:35:15.292419+0000","last_undegraded":"2024-04-15T23:35:15.292419+0000","last_fullsized":"2024-04-15T23:35:15.292419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298232+0000","last_change":"2024-04-15T23:35:07.919638+0000","last_active":"2024-04-15T23:35:13.298232+0000","last_peered":"2024-04-15T23:35:13.298232+0000","last_clean":"2024-04-15T23:35:13.298232+0000","last_became_active":"2024-04-15T23:35:07.919325+0000","last_became_peered":"2024-04-15T23:35:07.919325+0000","last_unstale":"2024-04-15T23:35:13.298232+0000","last_undegraded":"2024-04-15T23:35:13.298232+0000","last_fullsized":"2024-04-15T23:35:13.298232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:20.779700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292398+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:35:15.292398+0000","last_peered":"2024-04-15T23:35:15.292398+0000","last_clean":"2024-04-15T23:35:15.292398+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:35:15.292398+0000","last_undegraded":"2024-04-15T23:35:15.292398+0000","last_fullsized":"2024-04-15T23:35:15.292398+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":324,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292610+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:35:15.292610+0000","last_peered":"2024-04-15T23:35:15.292610+0000","last_clean":"2024-04-15T23:35:15.292610+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:35:15.292610+0000","last_undegraded":"2024-04-15T23:35:15.292610+0000","last_fullsized":"2024-04-15T23:35:15.292610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295958+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:35:13.295958+0000","last_peered":"2024-04-15T23:35:13.295958+0000","last_clean":"2024-04-15T23:35:13.295958+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:35:13.295958+0000","last_undegraded":"2024-04-15T23:35:13.295958+0000","last_fullsized":"2024-04-15T23:35:13.295958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":293,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295538+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:35:13.295538+0000","last_peered":"2024-04-15T23:35:13.295538+0000","last_clean":"2024-04-15T23:35:13.295538+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:35:13.295538+0000","last_undegraded":"2024-04-15T23:35:13.295538+0000","last_fullsized":"2024-04-15T23:35:13.295538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293034+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:35:15.293034+0000","last_peered":"2024-04-15T23:35:15.293034+0000","last_clean":"2024-04-15T23:35:15.293034+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:35:15.293034+0000","last_undegraded":"2024-04-15T23:35:15.293034+0000","last_fullsized":"2024-04-15T23:35:15.293034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292550+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:35:15.292550+0000","last_peered":"2024-04-15T23:35:15.292550+0000","last_clean":"2024-04-15T23:35:15.292550+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:35:15.292550+0000","last_undegraded":"2024-04-15T23:35:15.292550+0000","last_fullsized":"2024-04-15T23:35:15.292550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":244,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292162+0000","last_change":"2024-04-15T23:35:13.304044+0000","last_active":"2024-04-15T23:35:15.292162+0000","last_peered":"2024-04-15T23:35:15.292162+0000","last_clean":"2024-04-15T23:35:15.292162+0000","last_became_active":"2024-04-15T23:35:13.303268+0000","last_became_peered":"2024-04-15T23:35:13.303268+0000","last_unstale":"2024-04-15T23:35:15.292162+0000","last_undegraded":"2024-04-15T23:35:15.292162+0000","last_fullsized":"2024-04-15T23:35:15.292162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:46.714929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292683+0000","last_change":"2024-04-15T23:35:07.961077+0000","last_active":"2024-04-15T23:35:15.292683+0000","last_peered":"2024-04-15T23:35:15.292683+0000","last_clean":"2024-04-15T23:35:15.292683+0000","last_became_active":"2024-04-15T23:35:07.924404+0000","last_became_peered":"2024-04-15T23:35:07.924404+0000","last_unstale":"2024-04-15T23:35:15.292683+0000","last_undegraded":"2024-04-15T23:35:15.292683+0000","last_fullsized":"2024-04-15T23:35:15.292683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:26.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298355+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:35:13.298355+0000","last_peered":"2024-04-15T23:35:13.298355+0000","last_clean":"2024-04-15T23:35:13.298355+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:35:13.298355+0000","last_undegraded":"2024-04-15T23:35:13.298355+0000","last_fullsized":"2024-04-15T23:35:13.298355+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":255,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294755+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:35:13.294755+0000","last_peered":"2024-04-15T23:35:13.294755+0000","last_clean":"2024-04-15T23:35:13.294755+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:35:13.294755+0000","last_undegraded":"2024-04-15T23:35:13.294755+0000","last_fullsized":"2024-04-15T23:35:13.294755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":268,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298037+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:35:13.298037+0000","last_peered":"2024-04-15T23:35:13.298037+0000","last_clean":"2024-04-15T23:35:13.298037+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:35:13.298037+0000","last_undegraded":"2024-04-15T23:35:13.298037+0000","last_fullsized":"2024-04-15T23:35:13.298037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":158,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298319+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:35:13.298319+0000","last_peered":"2024-04-15T23:35:13.298319+0000","last_clean":"2024-04-15T23:35:13.298319+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:35:13.298319+0000","last_undegraded":"2024-04-15T23:35:13.298319+0000","last_fullsized":"2024-04-15T23:35:13.298319+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":238,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292065+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:35:15.292065+0000","last_peered":"2024-04-15T23:35:15.292065+0000","last_clean":"2024-04-15T23:35:15.292065+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:35:15.292065+0000","last_undegraded":"2024-04-15T23:35:15.292065+0000","last_fullsized":"2024-04-15T23:35:15.292065+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":138,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295649+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:35:13.295649+0000","last_peered":"2024-04-15T23:35:13.295649+0000","last_clean":"2024-04-15T23:35:13.295649+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:35:13.295649+0000","last_undegraded":"2024-04-15T23:35:13.295649+0000","last_fullsized":"2024-04-15T23:35:13.295649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298732+0000","last_change":"2024-04-15T23:35:07.923603+0000","last_active":"2024-04-15T23:35:13.298732+0000","last_peered":"2024-04-15T23:35:13.298732+0000","last_clean":"2024-04-15T23:35:13.298732+0000","last_became_active":"2024-04-15T23:35:07.923069+0000","last_became_peered":"2024-04-15T23:35:07.923069+0000","last_unstale":"2024-04-15T23:35:13.298732+0000","last_undegraded":"2024-04-15T23:35:13.298732+0000","last_fullsized":"2024-04-15T23:35:13.298732+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:39.536190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":267,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292131+0000","last_change":"2024-04-15T23:35:10.295722+0000","last_active":"2024-04-15T23:35:15.292131+0000","last_peered":"2024-04-15T23:35:15.292131+0000","last_clean":"2024-04-15T23:35:15.292131+0000","last_became_active":"2024-04-15T23:35:10.294673+0000","last_became_peered":"2024-04-15T23:35:10.294673+0000","last_unstale":"2024-04-15T23:35:15.292131+0000","last_undegraded":"2024-04-15T23:35:15.292131+0000","last_fullsized":"2024-04-15T23:35:15.292131+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:19.610009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293234+0000","last_change":"2024-04-15T23:35:07.923646+0000","last_active":"2024-04-15T23:35:15.293234+0000","last_peered":"2024-04-15T23:35:15.293234+0000","last_clean":"2024-04-15T23:35:15.293234+0000","last_became_active":"2024-04-15T23:35:07.923298+0000","last_became_peered":"2024-04-15T23:35:07.923298+0000","last_unstale":"2024-04-15T23:35:15.293234+0000","last_undegraded":"2024-04-15T23:35:15.293234+0000","last_fullsized":"2024-04-15T23:35:15.293234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:01.524255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292027+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:35:15.292027+0000","last_peered":"2024-04-15T23:35:15.292027+0000","last_clean":"2024-04-15T23:35:15.292027+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:35:15.292027+0000","last_undegraded":"2024-04-15T23:35:15.292027+0000","last_fullsized":"2024-04-15T23:35:15.292027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":284,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296397+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:35:13.296397+0000","last_peered":"2024-04-15T23:35:13.296397+0000","last_clean":"2024-04-15T23:35:13.296397+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:35:13.296397+0000","last_undegraded":"2024-04-15T23:35:13.296397+0000","last_fullsized":"2024-04-15T23:35:13.296397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.291871+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:35:15.291871+0000","last_peered":"2024-04-15T23:35:15.291871+0000","last_clean":"2024-04-15T23:35:15.291871+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:35:15.291871+0000","last_undegraded":"2024-04-15T23:35:15.291871+0000","last_fullsized":"2024-04-15T23:35:15.291871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":234,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-15T23:35:15.293451+0000","last_change":"2024-04-15T23:35:15.293451+0000","last_active":"2024-04-15T23:35:07.901641+0000","last_peered":"2024-04-15T23:35:05.897081+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:35:15.293451+0000","last_undegraded":"2024-04-15T23:35:15.293451+0000","last_fullsized":"2024-04-15T23:35:15.293451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.291937+0000","last_change":"2024-04-15T23:35:07.917897+0000","last_active":"2024-04-15T23:35:15.291937+0000","last_peered":"2024-04-15T23:35:15.291937+0000","last_clean":"2024-04-15T23:35:15.291937+0000","last_became_active":"2024-04-15T23:35:07.917508+0000","last_became_peered":"2024-04-15T23:35:07.917508+0000","last_unstale":"2024-04-15T23:35:15.291937+0000","last_undegraded":"2024-04-15T23:35:15.291937+0000","last_fullsized":"2024-04-15T23:35:15.291937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:41:58.784211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":261,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295243+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:35:13.295243+0000","last_peered":"2024-04-15T23:35:13.295243+0000","last_clean":"2024-04-15T23:35:13.295243+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:35:13.295243+0000","last_undegraded":"2024-04-15T23:35:13.295243+0000","last_fullsized":"2024-04-15T23:35:13.295243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":129,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295114+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:35:13.295114+0000","last_peered":"2024-04-15T23:35:13.295114+0000","last_clean":"2024-04-15T23:35:13.295114+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:35:13.295114+0000","last_undegraded":"2024-04-15T23:35:13.295114+0000","last_fullsized":"2024-04-15T23:35:13.295114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":492,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298781+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:35:13.298781+0000","last_peered":"2024-04-15T23:35:13.298781+0000","last_clean":"2024-04-15T23:35:13.298781+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:35:13.298781+0000","last_undegraded":"2024-04-15T23:35:13.298781+0000","last_fullsized":"2024-04-15T23:35:13.298781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":120,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295938+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:35:13.295938+0000","last_peered":"2024-04-15T23:35:13.295938+0000","last_clean":"2024-04-15T23:35:13.295938+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:35:13.295938+0000","last_undegraded":"2024-04-15T23:35:13.295938+0000","last_fullsized":"2024-04-15T23:35:13.295938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":485,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.971968+0000","last_change":"2024-04-15T23:35:13.297688+0000","last_active":"2024-04-15T23:35:13.297688+0000","last_peered":"2024-04-15T23:35:12.971968+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:35:08.966050+0000","last_became_peered":"2024-04-15T23:35:08.966050+0000","last_unstale":"2024-04-15T23:35:12.971968+0000","last_undegraded":"2024-04-15T23:35:12.971968+0000","last_fullsized":"2024-04-15T23:35:08.903476+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":111927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":124,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298247+0000","last_change":"2024-04-15T23:35:07.923605+0000","last_active":"2024-04-15T23:35:13.298247+0000","last_peered":"2024-04-15T23:35:13.298247+0000","last_clean":"2024-04-15T23:35:13.298247+0000","last_became_active":"2024-04-15T23:35:07.923048+0000","last_became_peered":"2024-04-15T23:35:07.923048+0000","last_unstale":"2024-04-15T23:35:13.298247+0000","last_undegraded":"2024-04-15T23:35:13.298247+0000","last_fullsized":"2024-04-15T23:35:13.298247+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:24.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":485,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297455+0000","last_change":"2024-04-15T23:35:12.299637+0000","last_active":"2024-04-15T23:35:13.297455+0000","last_peered":"2024-04-15T23:35:13.297455+0000","last_clean":"2024-04-15T23:35:13.297455+0000","last_became_active":"2024-04-15T23:35:12.298564+0000","last_became_peered":"2024-04-15T23:35:12.298564+0000","last_unstale":"2024-04-15T23:35:13.297455+0000","last_undegraded":"2024-04-15T23:35:13.297455+0000","last_fullsized":"2024-04-15T23:35:13.297455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:45:24.200208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":173945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":174,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295496+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:35:13.295496+0000","last_peered":"2024-04-15T23:35:13.295496+0000","last_clean":"2024-04-15T23:35:13.295496+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:35:13.295496+0000","last_undegraded":"2024-04-15T23:35:13.295496+0000","last_fullsized":"2024-04-15T23:35:13.295496+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":503,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294987+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:35:13.294987+0000","last_peered":"2024-04-15T23:35:13.294987+0000","last_clean":"2024-04-15T23:35:13.294987+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:35:13.294987+0000","last_undegraded":"2024-04-15T23:35:13.294987+0000","last_fullsized":"2024-04-15T23:35:13.294987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293602+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:35:15.293602+0000","last_peered":"2024-04-15T23:35:15.293602+0000","last_clean":"2024-04-15T23:35:15.293602+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:35:15.293602+0000","last_undegraded":"2024-04-15T23:35:15.293602+0000","last_fullsized":"2024-04-15T23:35:15.293602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":555,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297703+0000","last_change":"2024-04-15T23:35:12.299365+0000","last_active":"2024-04-15T23:35:13.297703+0000","last_peered":"2024-04-15T23:35:13.297703+0000","last_clean":"2024-04-15T23:35:13.297703+0000","last_became_active":"2024-04-15T23:35:12.298555+0000","last_became_peered":"2024-04-15T23:35:12.298555+0000","last_unstale":"2024-04-15T23:35:13.297703+0000","last_undegraded":"2024-04-15T23:35:13.297703+0000","last_fullsized":"2024-04-15T23:35:13.297703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:43:56.403627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":134131,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292753+0000","last_change":"2024-04-15T23:35:07.956652+0000","last_active":"2024-04-15T23:35:15.292753+0000","last_peered":"2024-04-15T23:35:15.292753+0000","last_clean":"2024-04-15T23:35:15.292753+0000","last_became_active":"2024-04-15T23:35:07.923145+0000","last_became_peered":"2024-04-15T23:35:07.923145+0000","last_unstale":"2024-04-15T23:35:15.292753+0000","last_undegraded":"2024-04-15T23:35:15.292753+0000","last_fullsized":"2024-04-15T23:35:15.292753+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:50:11.946892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":308,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4017,"num_bytes_recovered":12939682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73150464,"data_stored":52960937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20623652,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103171,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85304,"kb_used_data":45292,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286536,"statfs":{"total":96636764160,"available":96549412864,"internally_reserved":0,"allocated":46379008,"data_stored":39017992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83832,"kb_used_data":52652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94288008,"statfs":{"total":96636764160,"available":96550920192,"internally_reserved":0,"allocated":53915648,"data_stored":47013869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88812,"kb_used_data":57632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283028,"statfs":{"total":96636764160,"available":96545820672,"internally_reserved":0,"allocated":59015168,"data_stored":52117292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19513344,"data_stored":12945571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:35:17.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-15T23:35:18.361 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:18.362 INFO:teuthology.orchestra.run.smithi102.stdout:{"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 308/6962 objects degraded (4.424%), 3 pgs degraded","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":242,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":68,"num_osds":3,"num_up_osds":3,"osd_up_since":1713224106,"num_in_osds":3,"osd_in_since":1713223876,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":90},{"state_name":"peering","count":8},{"state_name":"active+undersized+remapped","count":3},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":3481,"data_bytes":68767978,"bytes_used":264138752,"bytes_avail":289646153728,"bytes_total":289910292480,"inactive_pgs_ratio":0.076190479099750519,"degraded_objects":308,"degraded_total":6962,"degraded_ratio":0.044240160873312263,"recovering_objects_per_sec":790,"recovering_bytes_per_sec":3533723,"recovering_keys_per_sec":0,"num_objects_recovered":3583,"num_bytes_recovered":16024588,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4218}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-04-15T23:32:37.780770+0000","services":{}},"progress_events":{}} 2024-04-15T23:35:18.374 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-15T23:35:18.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:35:18.665 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:18.667 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:35:18.675 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-04-15T23:35:17.828049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":308,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4024,"num_bytes_recovered":33563334,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257948,"kb_used_data":155576,"kb_used_omap":9,"kb_used_meta":102326,"kb_avail":282857572,"statfs":{"total":289910292480,"available":289646153728,"internally_reserved":0,"allocated":159309824,"data_stored":138149153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":104781937},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":308,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3583,"num_bytes_recovered":16024588,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.534759"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":476,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.299821+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:35:13.299821+0000","last_peered":"2024-04-15T23:35:13.299821+0000","last_clean":"2024-04-15T23:35:13.299821+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:35:13.299821+0000","last_undegraded":"2024-04-15T23:35:13.299821+0000","last_fullsized":"2024-04-15T23:35:13.299821+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":446,"reported_epoch":65,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-15T23:35:13.855054+0000","last_change":"2024-04-15T23:35:13.836134+0000","last_active":"2024-04-15T23:35:13.855054+0000","last_peered":"2024-04-15T23:35:13.855054+0000","last_clean":"2024-04-15T23:32:07.534174+0000","last_became_active":"2024-04-15T23:35:08.966346+0000","last_became_peered":"2024-04-15T23:35:08.966346+0000","last_unstale":"2024-04-15T23:35:13.855054+0000","last_undegraded":"2024-04-15T23:35:13.855054+0000","last_fullsized":"2024-04-15T23:35:08.902876+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":48}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":282,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297704+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:35:13.297704+0000","last_peered":"2024-04-15T23:35:13.297704+0000","last_clean":"2024-04-15T23:35:13.297704+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:35:13.297704+0000","last_undegraded":"2024-04-15T23:35:13.297704+0000","last_fullsized":"2024-04-15T23:35:13.297704+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":414,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.467475+0000","last_change":"2024-04-15T23:35:13.297397+0000","last_active":"2024-04-15T23:35:13.297397+0000","last_peered":"2024-04-15T23:35:12.467475+0000","last_clean":"2024-04-15T23:32:07.786532+0000","last_became_active":"2024-04-15T23:35:08.964645+0000","last_became_peered":"2024-04-15T23:35:08.964645+0000","last_unstale":"2024-04-15T23:35:12.467475+0000","last_undegraded":"2024-04-15T23:35:12.467475+0000","last_fullsized":"2024-04-15T23:35:08.904509+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":139423,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":290,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295640+0000","last_change":"2024-04-15T23:35:08.967663+0000","last_active":"2024-04-15T23:35:13.295640+0000","last_peered":"2024-04-15T23:35:13.295640+0000","last_clean":"2024-04-15T23:32:07.533945+0000","last_became_active":"2024-04-15T23:35:08.966945+0000","last_became_peered":"2024-04-15T23:35:08.966945+0000","last_unstale":"2024-04-15T23:35:13.295640+0000","last_undegraded":"2024-04-15T23:35:08.906099+0000","last_fullsized":"2024-04-15T23:35:08.904502+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":121,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":73}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":513,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.303626+0000","last_change":"2024-04-15T23:35:13.303626+0000","last_active":"2024-04-15T23:35:13.303626+0000","last_peered":"2024-04-15T23:35:13.303626+0000","last_clean":"2024-04-15T23:35:13.303626+0000","last_became_active":"2024-04-15T23:35:13.303020+0000","last_became_peered":"2024-04-15T23:35:13.303020+0000","last_unstale":"2024-04-15T23:35:13.303626+0000","last_undegraded":"2024-04-15T23:35:13.303626+0000","last_fullsized":"2024-04-15T23:35:13.303626+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:36.526930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":182889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":508,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297253+0000","last_change":"2024-04-15T23:35:11.296974+0000","last_active":"2024-04-15T23:35:13.297253+0000","last_peered":"2024-04-15T23:35:13.297253+0000","last_clean":"2024-04-15T23:35:13.297253+0000","last_became_active":"2024-04-15T23:35:11.296148+0000","last_became_peered":"2024-04-15T23:35:11.296148+0000","last_unstale":"2024-04-15T23:35:13.297253+0000","last_undegraded":"2024-04-15T23:35:13.297253+0000","last_fullsized":"2024-04-15T23:35:13.297253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:54:02.940157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":274228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":439,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297508+0000","last_change":"2024-04-15T23:35:12.299337+0000","last_active":"2024-04-15T23:35:13.297508+0000","last_peered":"2024-04-15T23:35:13.297508+0000","last_clean":"2024-04-15T23:35:13.297508+0000","last_became_active":"2024-04-15T23:35:12.298132+0000","last_became_peered":"2024-04-15T23:35:12.298132+0000","last_unstale":"2024-04-15T23:35:13.297508+0000","last_undegraded":"2024-04-15T23:35:13.297508+0000","last_fullsized":"2024-04-15T23:35:13.297508+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:56:07.706157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":98254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293143+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:35:15.293143+0000","last_peered":"2024-04-15T23:35:15.293143+0000","last_clean":"2024-04-15T23:35:15.293143+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:35:15.293143+0000","last_undegraded":"2024-04-15T23:35:15.293143+0000","last_fullsized":"2024-04-15T23:35:15.293143+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":269,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295221+0000","last_change":"2024-04-15T23:35:08.968933+0000","last_active":"2024-04-15T23:35:13.295221+0000","last_peered":"2024-04-15T23:35:13.295221+0000","last_clean":"2024-04-15T23:32:07.534223+0000","last_became_active":"2024-04-15T23:35:08.968156+0000","last_became_peered":"2024-04-15T23:35:08.968156+0000","last_unstale":"2024-04-15T23:35:13.295221+0000","last_undegraded":"2024-04-15T23:35:08.907306+0000","last_fullsized":"2024-04-15T23:35:08.904735+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":93,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":52}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":477,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297805+0000","last_change":"2024-04-15T23:35:10.294609+0000","last_active":"2024-04-15T23:35:13.297805+0000","last_peered":"2024-04-15T23:35:13.297805+0000","last_clean":"2024-04-15T23:35:13.297805+0000","last_became_active":"2024-04-15T23:35:10.294222+0000","last_became_peered":"2024-04-15T23:35:10.294222+0000","last_unstale":"2024-04-15T23:35:13.297805+0000","last_undegraded":"2024-04-15T23:35:13.297805+0000","last_fullsized":"2024-04-15T23:35:13.297805+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":192323,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":254,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":427,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:13.093403+0000","last_change":"2024-04-15T23:35:13.296237+0000","last_active":"2024-04-15T23:35:13.296237+0000","last_peered":"2024-04-15T23:35:13.093403+0000","last_clean":"2024-04-15T23:32:07.533830+0000","last_became_active":"2024-04-15T23:35:08.965939+0000","last_became_peered":"2024-04-15T23:35:08.965939+0000","last_unstale":"2024-04-15T23:35:13.093403+0000","last_undegraded":"2024-04-15T23:35:13.093403+0000","last_fullsized":"2024-04-15T23:35:08.902173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":290,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297258+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:35:13.297258+0000","last_peered":"2024-04-15T23:35:13.297258+0000","last_clean":"2024-04-15T23:35:13.297258+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:35:13.297258+0000","last_undegraded":"2024-04-15T23:35:13.297258+0000","last_fullsized":"2024-04-15T23:35:13.297258+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":270,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297273+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:35:13.297273+0000","last_peered":"2024-04-15T23:35:13.297273+0000","last_clean":"2024-04-15T23:35:13.297273+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:35:13.297273+0000","last_undegraded":"2024-04-15T23:35:13.297273+0000","last_fullsized":"2024-04-15T23:35:13.297273+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":525,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297566+0000","last_change":"2024-04-15T23:35:12.299129+0000","last_active":"2024-04-15T23:35:13.297566+0000","last_peered":"2024-04-15T23:35:13.297566+0000","last_clean":"2024-04-15T23:35:13.297566+0000","last_became_active":"2024-04-15T23:35:12.298025+0000","last_became_peered":"2024-04-15T23:35:12.298025+0000","last_unstale":"2024-04-15T23:35:13.297566+0000","last_undegraded":"2024-04-15T23:35:13.297566+0000","last_fullsized":"2024-04-15T23:35:13.297566+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:08:47.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1487227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293088+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:35:15.293088+0000","last_peered":"2024-04-15T23:35:15.293088+0000","last_clean":"2024-04-15T23:35:15.293088+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:35:15.293088+0000","last_undegraded":"2024-04-15T23:35:15.293088+0000","last_fullsized":"2024-04-15T23:35:15.293088+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":267,"reported_epoch":65,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-15T23:35:13.295677+0000","last_change":"2024-04-15T23:35:08.968935+0000","last_active":"2024-04-15T23:35:13.295677+0000","last_peered":"2024-04-15T23:35:13.295677+0000","last_clean":"2024-04-15T23:32:07.534367+0000","last_became_active":"2024-04-15T23:35:08.968128+0000","last_became_peered":"2024-04-15T23:35:08.968128+0000","last_unstale":"2024-04-15T23:35:13.295677+0000","last_undegraded":"2024-04-15T23:35:08.909234+0000","last_fullsized":"2024-04-15T23:35:08.907780+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":94,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":49}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":221,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-15T23:35:15.293210+0000","last_change":"2024-04-15T23:35:15.293210+0000","last_active":"2024-04-15T23:35:07.902727+0000","last_peered":"2024-04-15T23:35:06.093128+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.546015+0000","last_became_peered":"2024-04-15T23:32:11.546015+0000","last_unstale":"2024-04-15T23:35:15.293210+0000","last_undegraded":"2024-04-15T23:35:15.293210+0000","last_fullsized":"2024-04-15T23:35:15.293210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":536,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:13.236358+0000","last_change":"2024-04-15T23:35:13.298540+0000","last_active":"2024-04-15T23:35:13.298540+0000","last_peered":"2024-04-15T23:35:13.236358+0000","last_clean":"2024-04-15T23:32:07.786581+0000","last_became_active":"2024-04-15T23:35:08.966005+0000","last_became_peered":"2024-04-15T23:35:08.966005+0000","last_unstale":"2024-04-15T23:35:13.236358+0000","last_undegraded":"2024-04-15T23:35:13.236358+0000","last_fullsized":"2024-04-15T23:35:08.905437+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":244249,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":483,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.497678+0000","last_change":"2024-04-15T23:35:13.497831+0000","last_active":"2024-04-15T23:35:13.497678+0000","last_peered":"2024-04-15T23:35:13.497678+0000","last_clean":"2024-04-15T23:32:07.786558+0000","last_became_active":"2024-04-15T23:35:08.967036+0000","last_became_peered":"2024-04-15T23:35:08.967036+0000","last_unstale":"2024-04-15T23:35:13.497678+0000","last_undegraded":"2024-04-15T23:35:13.497678+0000","last_fullsized":"2024-04-15T23:35:08.907738+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87443,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":54}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":283,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294885+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:35:13.294885+0000","last_peered":"2024-04-15T23:35:13.294885+0000","last_clean":"2024-04-15T23:35:13.294885+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:35:13.294885+0000","last_undegraded":"2024-04-15T23:35:13.294885+0000","last_fullsized":"2024-04-15T23:35:13.294885+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292057+0000","last_change":"2024-04-15T23:35:10.294643+0000","last_active":"2024-04-15T23:35:15.292057+0000","last_peered":"2024-04-15T23:35:15.292057+0000","last_clean":"2024-04-15T23:35:15.292057+0000","last_became_active":"2024-04-15T23:35:10.293497+0000","last_became_peered":"2024-04-15T23:35:10.293497+0000","last_unstale":"2024-04-15T23:35:15.292057+0000","last_undegraded":"2024-04-15T23:35:15.292057+0000","last_fullsized":"2024-04-15T23:35:15.292057+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:12:59.503325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":499,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294682+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:35:13.294682+0000","last_peered":"2024-04-15T23:35:13.294682+0000","last_clean":"2024-04-15T23:35:13.294682+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:35:13.294682+0000","last_undegraded":"2024-04-15T23:35:13.294682+0000","last_fullsized":"2024-04-15T23:35:13.294682+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":269,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296097+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:35:13.296097+0000","last_peered":"2024-04-15T23:35:13.296097+0000","last_clean":"2024-04-15T23:35:13.296097+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:35:13.296097+0000","last_undegraded":"2024-04-15T23:35:13.296097+0000","last_fullsized":"2024-04-15T23:35:13.296097+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":267,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-15T23:35:15.293645+0000","last_change":"2024-04-15T23:35:15.293645+0000","last_active":"2024-04-15T23:35:07.916714+0000","last_peered":"2024-04-15T23:35:05.897597+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.548257+0000","last_became_peered":"2024-04-15T23:32:11.548257+0000","last_unstale":"2024-04-15T23:35:15.293645+0000","last_undegraded":"2024-04-15T23:35:15.293645+0000","last_fullsized":"2024-04-15T23:35:15.293645+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":273,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297895+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:35:13.297895+0000","last_peered":"2024-04-15T23:35:13.297895+0000","last_clean":"2024-04-15T23:35:13.297895+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:35:13.297895+0000","last_undegraded":"2024-04-15T23:35:13.297895+0000","last_fullsized":"2024-04-15T23:35:13.297895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":264,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296281+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:35:13.296281+0000","last_peered":"2024-04-15T23:35:13.296281+0000","last_clean":"2024-04-15T23:35:13.296281+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:35:13.296281+0000","last_undegraded":"2024-04-15T23:35:13.296281+0000","last_fullsized":"2024-04-15T23:35:13.296281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":252,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.296264+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:35:15.296264+0000","last_peered":"2024-04-15T23:35:15.296264+0000","last_clean":"2024-04-15T23:35:15.296264+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:35:15.296264+0000","last_undegraded":"2024-04-15T23:35:15.296264+0000","last_fullsized":"2024-04-15T23:35:15.296264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":306,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294986+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:35:13.294986+0000","last_peered":"2024-04-15T23:35:13.294986+0000","last_clean":"2024-04-15T23:35:13.294986+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:35:13.294986+0000","last_undegraded":"2024-04-15T23:35:13.294986+0000","last_fullsized":"2024-04-15T23:35:13.294986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":281,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292422+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:35:15.292422+0000","last_peered":"2024-04-15T23:35:15.292422+0000","last_clean":"2024-04-15T23:35:15.292422+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:35:15.292422+0000","last_undegraded":"2024-04-15T23:35:15.292422+0000","last_fullsized":"2024-04-15T23:35:15.292422+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":537,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297604+0000","last_change":"2024-04-15T23:35:11.297293+0000","last_active":"2024-04-15T23:35:13.297604+0000","last_peered":"2024-04-15T23:35:13.297604+0000","last_clean":"2024-04-15T23:35:13.297604+0000","last_became_active":"2024-04-15T23:35:11.296756+0000","last_became_peered":"2024-04-15T23:35:11.296756+0000","last_unstale":"2024-04-15T23:35:13.297604+0000","last_undegraded":"2024-04-15T23:35:13.297604+0000","last_fullsized":"2024-04-15T23:35:13.297604+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:58:45.896248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":127328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":457,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.577377+0000","last_change":"2024-04-15T23:35:13.296053+0000","last_active":"2024-04-15T23:35:13.296053+0000","last_peered":"2024-04-15T23:35:12.577377+0000","last_clean":"2024-04-15T23:32:07.533986+0000","last_became_active":"2024-04-15T23:35:08.965317+0000","last_became_peered":"2024-04-15T23:35:08.965317+0000","last_unstale":"2024-04-15T23:35:12.577377+0000","last_undegraded":"2024-04-15T23:35:12.577377+0000","last_fullsized":"2024-04-15T23:35:08.906044+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298212+0000","last_change":"2024-04-15T23:35:10.294028+0000","last_active":"2024-04-15T23:35:13.298212+0000","last_peered":"2024-04-15T23:35:13.298212+0000","last_clean":"2024-04-15T23:35:13.298212+0000","last_became_active":"2024-04-15T23:35:10.293804+0000","last_became_peered":"2024-04-15T23:35:10.293804+0000","last_unstale":"2024-04-15T23:35:13.298212+0000","last_undegraded":"2024-04-15T23:35:13.298212+0000","last_fullsized":"2024-04-15T23:35:13.298212+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:14.050412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3518792,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":462,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295398+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:35:13.295398+0000","last_peered":"2024-04-15T23:35:13.295398+0000","last_clean":"2024-04-15T23:35:13.295398+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:35:13.295398+0000","last_undegraded":"2024-04-15T23:35:13.295398+0000","last_fullsized":"2024-04-15T23:35:13.295398+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292113+0000","last_change":"2024-04-15T23:35:07.923327+0000","last_active":"2024-04-15T23:35:15.292113+0000","last_peered":"2024-04-15T23:35:15.292113+0000","last_clean":"2024-04-15T23:35:15.292113+0000","last_became_active":"2024-04-15T23:35:07.923022+0000","last_became_peered":"2024-04-15T23:35:07.923022+0000","last_unstale":"2024-04-15T23:35:15.292113+0000","last_undegraded":"2024-04-15T23:35:15.292113+0000","last_fullsized":"2024-04-15T23:35:15.292113+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:56.197588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":277,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.296797+0000","last_change":"2024-04-15T23:35:15.296797+0000","last_active":"2024-04-15T23:35:15.296797+0000","last_peered":"2024-04-15T23:35:15.296797+0000","last_clean":"2024-04-15T23:35:15.296797+0000","last_became_active":"2024-04-15T23:35:15.295475+0000","last_became_peered":"2024-04-15T23:35:15.295475+0000","last_unstale":"2024-04-15T23:35:15.296797+0000","last_undegraded":"2024-04-15T23:35:15.296797+0000","last_fullsized":"2024-04-15T23:35:15.296797+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:57:52.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":115,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294857+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:35:13.294857+0000","last_peered":"2024-04-15T23:35:13.294857+0000","last_clean":"2024-04-15T23:35:13.294857+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:35:13.294857+0000","last_undegraded":"2024-04-15T23:35:13.294857+0000","last_fullsized":"2024-04-15T23:35:13.294857+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":267,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292713+0000","last_change":"2024-04-15T23:35:13.304246+0000","last_active":"2024-04-15T23:35:15.292713+0000","last_peered":"2024-04-15T23:35:15.292713+0000","last_clean":"2024-04-15T23:35:15.292713+0000","last_became_active":"2024-04-15T23:35:13.303224+0000","last_became_peered":"2024-04-15T23:35:13.303224+0000","last_unstale":"2024-04-15T23:35:15.292713+0000","last_undegraded":"2024-04-15T23:35:15.292713+0000","last_fullsized":"2024-04-15T23:35:15.292713+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:12.292741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":124,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297842+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:35:13.297842+0000","last_peered":"2024-04-15T23:35:13.297842+0000","last_clean":"2024-04-15T23:35:13.297842+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:35:13.297842+0000","last_undegraded":"2024-04-15T23:35:13.297842+0000","last_fullsized":"2024-04-15T23:35:13.297842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":116,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298229+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:35:13.298229+0000","last_peered":"2024-04-15T23:35:13.298229+0000","last_clean":"2024-04-15T23:35:13.298229+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:35:13.298229+0000","last_undegraded":"2024-04-15T23:35:13.298229+0000","last_fullsized":"2024-04-15T23:35:13.298229+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":266,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294692+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:35:13.294692+0000","last_peered":"2024-04-15T23:35:13.294692+0000","last_clean":"2024-04-15T23:35:13.294692+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:35:13.294692+0000","last_undegraded":"2024-04-15T23:35:13.294692+0000","last_fullsized":"2024-04-15T23:35:13.294692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":118,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295849+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:35:13.295849+0000","last_peered":"2024-04-15T23:35:13.295849+0000","last_clean":"2024-04-15T23:35:13.295849+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:35:13.295849+0000","last_undegraded":"2024-04-15T23:35:13.295849+0000","last_fullsized":"2024-04-15T23:35:13.295849+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":536,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294757+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:35:13.294757+0000","last_peered":"2024-04-15T23:35:13.294757+0000","last_clean":"2024-04-15T23:35:13.294757+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:35:13.294757+0000","last_undegraded":"2024-04-15T23:35:13.294757+0000","last_fullsized":"2024-04-15T23:35:13.294757+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":116,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298172+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:35:13.298172+0000","last_peered":"2024-04-15T23:35:13.298172+0000","last_clean":"2024-04-15T23:35:13.298172+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:35:13.298172+0000","last_undegraded":"2024-04-15T23:35:13.298172+0000","last_fullsized":"2024-04-15T23:35:13.298172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":467,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.300527+0000","last_change":"2024-04-15T23:35:13.300527+0000","last_active":"2024-04-15T23:35:13.300527+0000","last_peered":"2024-04-15T23:35:13.300527+0000","last_clean":"2024-04-15T23:35:13.300527+0000","last_became_active":"2024-04-15T23:35:13.300095+0000","last_became_peered":"2024-04-15T23:35:13.300095+0000","last_unstale":"2024-04-15T23:35:13.300527+0000","last_undegraded":"2024-04-15T23:35:13.300527+0000","last_fullsized":"2024-04-15T23:35:13.300527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:44.585807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":66508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":123,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298559+0000","last_change":"2024-04-15T23:35:07.923940+0000","last_active":"2024-04-15T23:35:13.298559+0000","last_peered":"2024-04-15T23:35:13.298559+0000","last_clean":"2024-04-15T23:35:13.298559+0000","last_became_active":"2024-04-15T23:35:07.923559+0000","last_became_peered":"2024-04-15T23:35:07.923559+0000","last_unstale":"2024-04-15T23:35:13.298559+0000","last_undegraded":"2024-04-15T23:35:13.298559+0000","last_fullsized":"2024-04-15T23:35:13.298559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:34.992257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":243,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292966+0000","last_change":"2024-04-15T23:35:14.303298+0000","last_active":"2024-04-15T23:35:15.292966+0000","last_peered":"2024-04-15T23:35:15.292966+0000","last_clean":"2024-04-15T23:35:15.292966+0000","last_became_active":"2024-04-15T23:35:14.302372+0000","last_became_peered":"2024-04-15T23:35:14.302372+0000","last_unstale":"2024-04-15T23:35:15.292966+0000","last_undegraded":"2024-04-15T23:35:15.292966+0000","last_fullsized":"2024-04-15T23:35:15.292966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:27.003926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292609+0000","last_change":"2024-04-15T23:35:07.979404+0000","last_active":"2024-04-15T23:35:15.292609+0000","last_peered":"2024-04-15T23:35:15.292609+0000","last_clean":"2024-04-15T23:35:15.292609+0000","last_became_active":"2024-04-15T23:35:07.924742+0000","last_became_peered":"2024-04-15T23:35:07.924742+0000","last_unstale":"2024-04-15T23:35:15.292609+0000","last_undegraded":"2024-04-15T23:35:15.292609+0000","last_fullsized":"2024-04-15T23:35:15.292609+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:59.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":529,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.748974+0000","last_change":"2024-04-15T23:35:13.749125+0000","last_active":"2024-04-15T23:35:13.748974+0000","last_peered":"2024-04-15T23:35:13.748974+0000","last_clean":"2024-04-15T23:32:07.786626+0000","last_became_active":"2024-04-15T23:35:08.968016+0000","last_became_peered":"2024-04-15T23:35:08.968016+0000","last_unstale":"2024-04-15T23:35:13.748974+0000","last_undegraded":"2024-04-15T23:35:13.748974+0000","last_fullsized":"2024-04-15T23:35:08.909140+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":91970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[{"shards":"1","objects":58}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297486+0000","last_change":"2024-04-15T23:35:07.919642+0000","last_active":"2024-04-15T23:35:13.297486+0000","last_peered":"2024-04-15T23:35:13.297486+0000","last_clean":"2024-04-15T23:35:13.297486+0000","last_became_active":"2024-04-15T23:35:07.919354+0000","last_became_peered":"2024-04-15T23:35:07.919354+0000","last_unstale":"2024-04-15T23:35:13.297486+0000","last_undegraded":"2024-04-15T23:35:13.297486+0000","last_fullsized":"2024-04-15T23:35:13.297486+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:24.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":279,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298064+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:35:13.298064+0000","last_peered":"2024-04-15T23:35:13.298064+0000","last_clean":"2024-04-15T23:35:13.298064+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:35:13.298064+0000","last_undegraded":"2024-04-15T23:35:13.298064+0000","last_fullsized":"2024-04-15T23:35:13.298064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":115,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":251,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298638+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:35:13.298638+0000","last_peered":"2024-04-15T23:35:13.298638+0000","last_clean":"2024-04-15T23:35:13.298638+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:35:13.298638+0000","last_undegraded":"2024-04-15T23:35:13.298638+0000","last_fullsized":"2024-04-15T23:35:13.298638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":123,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294792+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:35:13.294792+0000","last_peered":"2024-04-15T23:35:13.294792+0000","last_clean":"2024-04-15T23:35:13.294792+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:35:13.294792+0000","last_undegraded":"2024-04-15T23:35:13.294792+0000","last_fullsized":"2024-04-15T23:35:13.294792+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":234,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293356+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:35:15.293356+0000","last_peered":"2024-04-15T23:35:15.293356+0000","last_clean":"2024-04-15T23:35:15.293356+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:35:15.293356+0000","last_undegraded":"2024-04-15T23:35:15.293356+0000","last_fullsized":"2024-04-15T23:35:15.293356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":317,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297884+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:35:13.297884+0000","last_peered":"2024-04-15T23:35:13.297884+0000","last_clean":"2024-04-15T23:35:13.297884+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:35:13.297884+0000","last_undegraded":"2024-04-15T23:35:13.297884+0000","last_fullsized":"2024-04-15T23:35:13.297884+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298552+0000","last_change":"2024-04-15T23:35:07.919572+0000","last_active":"2024-04-15T23:35:13.298552+0000","last_peered":"2024-04-15T23:35:13.298552+0000","last_clean":"2024-04-15T23:35:13.298552+0000","last_became_active":"2024-04-15T23:35:07.919258+0000","last_became_peered":"2024-04-15T23:35:07.919258+0000","last_unstale":"2024-04-15T23:35:13.298552+0000","last_undegraded":"2024-04-15T23:35:13.298552+0000","last_fullsized":"2024-04-15T23:35:13.298552+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:56.248931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292277+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:35:15.292277+0000","last_peered":"2024-04-15T23:35:15.292277+0000","last_clean":"2024-04-15T23:35:15.292277+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:35:15.292277+0000","last_undegraded":"2024-04-15T23:35:15.292277+0000","last_fullsized":"2024-04-15T23:35:15.292277+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":264,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298128+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:35:13.298128+0000","last_peered":"2024-04-15T23:35:13.298128+0000","last_clean":"2024-04-15T23:35:13.298128+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:35:13.298128+0000","last_undegraded":"2024-04-15T23:35:13.298128+0000","last_fullsized":"2024-04-15T23:35:13.298128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297801+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:35:13.297801+0000","last_peered":"2024-04-15T23:35:13.297801+0000","last_clean":"2024-04-15T23:35:13.297801+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:35:13.297801+0000","last_undegraded":"2024-04-15T23:35:13.297801+0000","last_fullsized":"2024-04-15T23:35:13.297801+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292017+0000","last_change":"2024-04-15T23:35:07.935306+0000","last_active":"2024-04-15T23:35:15.292017+0000","last_peered":"2024-04-15T23:35:15.292017+0000","last_clean":"2024-04-15T23:35:15.292017+0000","last_became_active":"2024-04-15T23:35:07.919625+0000","last_became_peered":"2024-04-15T23:35:07.919625+0000","last_unstale":"2024-04-15T23:35:15.292017+0000","last_undegraded":"2024-04-15T23:35:15.292017+0000","last_fullsized":"2024-04-15T23:35:15.292017+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:49:44.043170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":486,"reported_epoch":65,"state":"active+undersized+remapped","last_fresh":"2024-04-15T23:35:13.620762+0000","last_change":"2024-04-15T23:35:13.620914+0000","last_active":"2024-04-15T23:35:13.620762+0000","last_peered":"2024-04-15T23:35:13.620762+0000","last_clean":"2024-04-15T23:32:07.534271+0000","last_became_active":"2024-04-15T23:35:08.966327+0000","last_became_peered":"2024-04-15T23:35:08.966327+0000","last_unstale":"2024-04-15T23:35:13.620762+0000","last_undegraded":"2024-04-15T23:35:08.907357+0000","last_fullsized":"2024-04-15T23:35:08.904728+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[{"shards":"0","objects":57}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292251+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:35:15.292251+0000","last_peered":"2024-04-15T23:35:15.292251+0000","last_clean":"2024-04-15T23:35:15.292251+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:35:15.292251+0000","last_undegraded":"2024-04-15T23:35:15.292251+0000","last_fullsized":"2024-04-15T23:35:15.292251+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":171,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294825+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:35:13.294825+0000","last_peered":"2024-04-15T23:35:13.294825+0000","last_clean":"2024-04-15T23:35:13.294825+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:35:13.294825+0000","last_undegraded":"2024-04-15T23:35:13.294825+0000","last_fullsized":"2024-04-15T23:35:13.294825+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":255,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293358+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:35:15.293358+0000","last_peered":"2024-04-15T23:35:15.293358+0000","last_clean":"2024-04-15T23:35:15.293358+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:35:15.293358+0000","last_undegraded":"2024-04-15T23:35:15.293358+0000","last_fullsized":"2024-04-15T23:35:15.293358+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297712+0000","last_change":"2024-04-15T23:35:07.919852+0000","last_active":"2024-04-15T23:35:13.297712+0000","last_peered":"2024-04-15T23:35:13.297712+0000","last_clean":"2024-04-15T23:35:13.297712+0000","last_became_active":"2024-04-15T23:35:07.919642+0000","last_became_peered":"2024-04-15T23:35:07.919642+0000","last_unstale":"2024-04-15T23:35:13.297712+0000","last_undegraded":"2024-04-15T23:35:13.297712+0000","last_fullsized":"2024-04-15T23:35:13.297712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:29.682287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298313+0000","last_change":"2024-04-15T23:35:07.923775+0000","last_active":"2024-04-15T23:35:13.298313+0000","last_peered":"2024-04-15T23:35:13.298313+0000","last_clean":"2024-04-15T23:35:13.298313+0000","last_became_active":"2024-04-15T23:35:07.923310+0000","last_became_peered":"2024-04-15T23:35:07.923310+0000","last_unstale":"2024-04-15T23:35:13.298313+0000","last_undegraded":"2024-04-15T23:35:13.298313+0000","last_fullsized":"2024-04-15T23:35:13.298313+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:44.456832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":244,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292419+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:35:15.292419+0000","last_peered":"2024-04-15T23:35:15.292419+0000","last_clean":"2024-04-15T23:35:15.292419+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:35:15.292419+0000","last_undegraded":"2024-04-15T23:35:15.292419+0000","last_fullsized":"2024-04-15T23:35:15.292419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298232+0000","last_change":"2024-04-15T23:35:07.919638+0000","last_active":"2024-04-15T23:35:13.298232+0000","last_peered":"2024-04-15T23:35:13.298232+0000","last_clean":"2024-04-15T23:35:13.298232+0000","last_became_active":"2024-04-15T23:35:07.919325+0000","last_became_peered":"2024-04-15T23:35:07.919325+0000","last_unstale":"2024-04-15T23:35:13.298232+0000","last_undegraded":"2024-04-15T23:35:13.298232+0000","last_fullsized":"2024-04-15T23:35:13.298232+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:20.779700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292398+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:35:15.292398+0000","last_peered":"2024-04-15T23:35:15.292398+0000","last_clean":"2024-04-15T23:35:15.292398+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:35:15.292398+0000","last_undegraded":"2024-04-15T23:35:15.292398+0000","last_fullsized":"2024-04-15T23:35:15.292398+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":324,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294932+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:35:13.294932+0000","last_peered":"2024-04-15T23:35:13.294932+0000","last_clean":"2024-04-15T23:35:13.294932+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:35:13.294932+0000","last_undegraded":"2024-04-15T23:35:13.294932+0000","last_fullsized":"2024-04-15T23:35:13.294932+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292610+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:35:15.292610+0000","last_peered":"2024-04-15T23:35:15.292610+0000","last_clean":"2024-04-15T23:35:15.292610+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:35:15.292610+0000","last_undegraded":"2024-04-15T23:35:15.292610+0000","last_fullsized":"2024-04-15T23:35:15.292610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295958+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:35:13.295958+0000","last_peered":"2024-04-15T23:35:13.295958+0000","last_clean":"2024-04-15T23:35:13.295958+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:35:13.295958+0000","last_undegraded":"2024-04-15T23:35:13.295958+0000","last_fullsized":"2024-04-15T23:35:13.295958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":293,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295538+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:35:13.295538+0000","last_peered":"2024-04-15T23:35:13.295538+0000","last_clean":"2024-04-15T23:35:13.295538+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:35:13.295538+0000","last_undegraded":"2024-04-15T23:35:13.295538+0000","last_fullsized":"2024-04-15T23:35:13.295538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":40,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293034+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:35:15.293034+0000","last_peered":"2024-04-15T23:35:15.293034+0000","last_clean":"2024-04-15T23:35:15.293034+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:35:15.293034+0000","last_undegraded":"2024-04-15T23:35:15.293034+0000","last_fullsized":"2024-04-15T23:35:15.293034+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292550+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:35:15.292550+0000","last_peered":"2024-04-15T23:35:15.292550+0000","last_clean":"2024-04-15T23:35:15.292550+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:35:15.292550+0000","last_undegraded":"2024-04-15T23:35:15.292550+0000","last_fullsized":"2024-04-15T23:35:15.292550+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":244,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292162+0000","last_change":"2024-04-15T23:35:13.304044+0000","last_active":"2024-04-15T23:35:15.292162+0000","last_peered":"2024-04-15T23:35:15.292162+0000","last_clean":"2024-04-15T23:35:15.292162+0000","last_became_active":"2024-04-15T23:35:13.303268+0000","last_became_peered":"2024-04-15T23:35:13.303268+0000","last_unstale":"2024-04-15T23:35:15.292162+0000","last_undegraded":"2024-04-15T23:35:15.292162+0000","last_fullsized":"2024-04-15T23:35:15.292162+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:46.714929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":55,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292683+0000","last_change":"2024-04-15T23:35:07.961077+0000","last_active":"2024-04-15T23:35:15.292683+0000","last_peered":"2024-04-15T23:35:15.292683+0000","last_clean":"2024-04-15T23:35:15.292683+0000","last_became_active":"2024-04-15T23:35:07.924404+0000","last_became_peered":"2024-04-15T23:35:07.924404+0000","last_unstale":"2024-04-15T23:35:15.292683+0000","last_undegraded":"2024-04-15T23:35:15.292683+0000","last_fullsized":"2024-04-15T23:35:15.292683+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:26.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298355+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:35:13.298355+0000","last_peered":"2024-04-15T23:35:13.298355+0000","last_clean":"2024-04-15T23:35:13.298355+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:35:13.298355+0000","last_undegraded":"2024-04-15T23:35:13.298355+0000","last_fullsized":"2024-04-15T23:35:13.298355+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":255,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294755+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:35:13.294755+0000","last_peered":"2024-04-15T23:35:13.294755+0000","last_clean":"2024-04-15T23:35:13.294755+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:35:13.294755+0000","last_undegraded":"2024-04-15T23:35:13.294755+0000","last_fullsized":"2024-04-15T23:35:13.294755+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":268,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298037+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:35:13.298037+0000","last_peered":"2024-04-15T23:35:13.298037+0000","last_clean":"2024-04-15T23:35:13.298037+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:35:13.298037+0000","last_undegraded":"2024-04-15T23:35:13.298037+0000","last_fullsized":"2024-04-15T23:35:13.298037+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":158,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298319+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:35:13.298319+0000","last_peered":"2024-04-15T23:35:13.298319+0000","last_clean":"2024-04-15T23:35:13.298319+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:35:13.298319+0000","last_undegraded":"2024-04-15T23:35:13.298319+0000","last_fullsized":"2024-04-15T23:35:13.298319+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":238,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292065+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:35:15.292065+0000","last_peered":"2024-04-15T23:35:15.292065+0000","last_clean":"2024-04-15T23:35:15.292065+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:35:15.292065+0000","last_undegraded":"2024-04-15T23:35:15.292065+0000","last_fullsized":"2024-04-15T23:35:15.292065+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":138,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295649+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:35:13.295649+0000","last_peered":"2024-04-15T23:35:13.295649+0000","last_clean":"2024-04-15T23:35:13.295649+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:35:13.295649+0000","last_undegraded":"2024-04-15T23:35:13.295649+0000","last_fullsized":"2024-04-15T23:35:13.295649+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":122,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298732+0000","last_change":"2024-04-15T23:35:07.923603+0000","last_active":"2024-04-15T23:35:13.298732+0000","last_peered":"2024-04-15T23:35:13.298732+0000","last_clean":"2024-04-15T23:35:13.298732+0000","last_became_active":"2024-04-15T23:35:07.923069+0000","last_became_peered":"2024-04-15T23:35:07.923069+0000","last_unstale":"2024-04-15T23:35:13.298732+0000","last_undegraded":"2024-04-15T23:35:13.298732+0000","last_fullsized":"2024-04-15T23:35:13.298732+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:39.536190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":267,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292131+0000","last_change":"2024-04-15T23:35:10.295722+0000","last_active":"2024-04-15T23:35:15.292131+0000","last_peered":"2024-04-15T23:35:15.292131+0000","last_clean":"2024-04-15T23:35:15.292131+0000","last_became_active":"2024-04-15T23:35:10.294673+0000","last_became_peered":"2024-04-15T23:35:10.294673+0000","last_unstale":"2024-04-15T23:35:15.292131+0000","last_undegraded":"2024-04-15T23:35:15.292131+0000","last_fullsized":"2024-04-15T23:35:15.292131+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:19.610009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293234+0000","last_change":"2024-04-15T23:35:07.923646+0000","last_active":"2024-04-15T23:35:15.293234+0000","last_peered":"2024-04-15T23:35:15.293234+0000","last_clean":"2024-04-15T23:35:15.293234+0000","last_became_active":"2024-04-15T23:35:07.923298+0000","last_became_peered":"2024-04-15T23:35:07.923298+0000","last_unstale":"2024-04-15T23:35:15.293234+0000","last_undegraded":"2024-04-15T23:35:15.293234+0000","last_fullsized":"2024-04-15T23:35:15.293234+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:01.524255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292027+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:35:15.292027+0000","last_peered":"2024-04-15T23:35:15.292027+0000","last_clean":"2024-04-15T23:35:15.292027+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:35:15.292027+0000","last_undegraded":"2024-04-15T23:35:15.292027+0000","last_fullsized":"2024-04-15T23:35:15.292027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":284,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.296397+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:35:13.296397+0000","last_peered":"2024-04-15T23:35:13.296397+0000","last_clean":"2024-04-15T23:35:13.296397+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:35:13.296397+0000","last_undegraded":"2024-04-15T23:35:13.296397+0000","last_fullsized":"2024-04-15T23:35:13.296397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.291871+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:35:15.291871+0000","last_peered":"2024-04-15T23:35:15.291871+0000","last_clean":"2024-04-15T23:35:15.291871+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:35:15.291871+0000","last_undegraded":"2024-04-15T23:35:15.291871+0000","last_fullsized":"2024-04-15T23:35:15.291871+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":234,"reported_epoch":67,"state":"peering","last_fresh":"2024-04-15T23:35:15.293451+0000","last_change":"2024-04-15T23:35:15.293451+0000","last_active":"2024-04-15T23:35:07.901641+0000","last_peered":"2024-04-15T23:35:05.897081+0000","last_clean":"2024-04-15T23:31:29.854434+0000","last_became_active":"2024-04-15T23:32:11.547180+0000","last_became_peered":"2024-04-15T23:32:11.547180+0000","last_unstale":"2024-04-15T23:35:15.293451+0000","last_undegraded":"2024-04-15T23:35:15.293451+0000","last_fullsized":"2024-04-15T23:35:15.293451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.291937+0000","last_change":"2024-04-15T23:35:07.917897+0000","last_active":"2024-04-15T23:35:15.291937+0000","last_peered":"2024-04-15T23:35:15.291937+0000","last_clean":"2024-04-15T23:35:15.291937+0000","last_became_active":"2024-04-15T23:35:07.917508+0000","last_became_peered":"2024-04-15T23:35:07.917508+0000","last_unstale":"2024-04-15T23:35:15.291937+0000","last_undegraded":"2024-04-15T23:35:15.291937+0000","last_fullsized":"2024-04-15T23:35:15.291937+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:41:58.784211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":261,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295243+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:35:13.295243+0000","last_peered":"2024-04-15T23:35:13.295243+0000","last_clean":"2024-04-15T23:35:13.295243+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:35:13.295243+0000","last_undegraded":"2024-04-15T23:35:13.295243+0000","last_fullsized":"2024-04-15T23:35:13.295243+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":129,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295114+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:35:13.295114+0000","last_peered":"2024-04-15T23:35:13.295114+0000","last_clean":"2024-04-15T23:35:13.295114+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:35:13.295114+0000","last_undegraded":"2024-04-15T23:35:13.295114+0000","last_fullsized":"2024-04-15T23:35:13.295114+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":492,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298781+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:35:13.298781+0000","last_peered":"2024-04-15T23:35:13.298781+0000","last_clean":"2024-04-15T23:35:13.298781+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:35:13.298781+0000","last_undegraded":"2024-04-15T23:35:13.298781+0000","last_fullsized":"2024-04-15T23:35:13.298781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":120,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295938+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:35:13.295938+0000","last_peered":"2024-04-15T23:35:13.295938+0000","last_clean":"2024-04-15T23:35:13.295938+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:35:13.295938+0000","last_undegraded":"2024-04-15T23:35:13.295938+0000","last_fullsized":"2024-04-15T23:35:13.295938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":485,"reported_epoch":64,"state":"peering","last_fresh":"2024-04-15T23:35:12.971968+0000","last_change":"2024-04-15T23:35:13.297688+0000","last_active":"2024-04-15T23:35:13.297688+0000","last_peered":"2024-04-15T23:35:12.971968+0000","last_clean":"2024-04-15T23:32:07.786404+0000","last_became_active":"2024-04-15T23:35:08.966050+0000","last_became_peered":"2024-04-15T23:35:08.966050+0000","last_unstale":"2024-04-15T23:35:12.971968+0000","last_undegraded":"2024-04-15T23:35:12.971968+0000","last_fullsized":"2024-04-15T23:35:08.903476+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":111927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":124,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.298247+0000","last_change":"2024-04-15T23:35:07.923605+0000","last_active":"2024-04-15T23:35:13.298247+0000","last_peered":"2024-04-15T23:35:13.298247+0000","last_clean":"2024-04-15T23:35:13.298247+0000","last_became_active":"2024-04-15T23:35:07.923048+0000","last_became_peered":"2024-04-15T23:35:07.923048+0000","last_unstale":"2024-04-15T23:35:13.298247+0000","last_undegraded":"2024-04-15T23:35:13.298247+0000","last_fullsized":"2024-04-15T23:35:13.298247+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:24.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":485,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297455+0000","last_change":"2024-04-15T23:35:12.299637+0000","last_active":"2024-04-15T23:35:13.297455+0000","last_peered":"2024-04-15T23:35:13.297455+0000","last_clean":"2024-04-15T23:35:13.297455+0000","last_became_active":"2024-04-15T23:35:12.298564+0000","last_became_peered":"2024-04-15T23:35:12.298564+0000","last_unstale":"2024-04-15T23:35:13.297455+0000","last_undegraded":"2024-04-15T23:35:13.297455+0000","last_fullsized":"2024-04-15T23:35:13.297455+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:45:24.200208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":173945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":174,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.295496+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:35:13.295496+0000","last_peered":"2024-04-15T23:35:13.295496+0000","last_clean":"2024-04-15T23:35:13.295496+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:35:13.295496+0000","last_undegraded":"2024-04-15T23:35:13.295496+0000","last_fullsized":"2024-04-15T23:35:13.295496+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":503,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.294987+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:35:13.294987+0000","last_peered":"2024-04-15T23:35:13.294987+0000","last_clean":"2024-04-15T23:35:13.294987+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:35:13.294987+0000","last_undegraded":"2024-04-15T23:35:13.294987+0000","last_fullsized":"2024-04-15T23:35:13.294987+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.293602+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:35:15.293602+0000","last_peered":"2024-04-15T23:35:15.293602+0000","last_clean":"2024-04-15T23:35:15.293602+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:35:15.293602+0000","last_undegraded":"2024-04-15T23:35:15.293602+0000","last_fullsized":"2024-04-15T23:35:15.293602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":555,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-15T23:35:13.297703+0000","last_change":"2024-04-15T23:35:12.299365+0000","last_active":"2024-04-15T23:35:13.297703+0000","last_peered":"2024-04-15T23:35:13.297703+0000","last_clean":"2024-04-15T23:35:13.297703+0000","last_became_active":"2024-04-15T23:35:12.298555+0000","last_became_peered":"2024-04-15T23:35:12.298555+0000","last_unstale":"2024-04-15T23:35:13.297703+0000","last_undegraded":"2024-04-15T23:35:13.297703+0000","last_fullsized":"2024-04-15T23:35:13.297703+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:43:56.403627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":134131,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":44,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-15T23:35:15.292753+0000","last_change":"2024-04-15T23:35:07.956652+0000","last_active":"2024-04-15T23:35:15.292753+0000","last_peered":"2024-04-15T23:35:15.292753+0000","last_clean":"2024-04-15T23:35:15.292753+0000","last_became_active":"2024-04-15T23:35:07.923145+0000","last_became_peered":"2024-04-15T23:35:07.923145+0000","last_unstale":"2024-04-15T23:35:15.292753+0000","last_undegraded":"2024-04-15T23:35:15.292753+0000","last_fullsized":"2024-04-15T23:35:15.292753+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:50:11.946892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":308,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4017,"num_bytes_recovered":12939682,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73150464,"data_stored":52960937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20623652,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103171,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85304,"kb_used_data":45292,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286536,"statfs":{"total":96636764160,"available":96549412864,"internally_reserved":0,"allocated":46379008,"data_stored":39017992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83832,"kb_used_data":52652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94288008,"statfs":{"total":96636764160,"available":96550920192,"internally_reserved":0,"allocated":53915648,"data_stored":47013869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88812,"kb_used_data":57632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283028,"statfs":{"total":96636764160,"available":96545820672,"internally_reserved":0,"allocated":59015168,"data_stored":52117292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19513344,"data_stored":12945571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:35:21.680 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:35:21.996 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:35:21.997 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:35:22.007 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-04-15T23:35:21.828848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4650,"num_bytes_recovered":38742972,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":257744,"kb_used_data":155364,"kb_used_omap":9,"kb_used_meta":102326,"kb_avail":282857776,"statfs":{"total":289910292480,"available":289646362624,"internally_reserved":0,"allocated":159092736,"data_stored":138047211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10127,"internal_metadata":104781937},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-732,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1639,"num_bytes_recovered":7147330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.534393"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":482,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297308+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:35:16.297308+0000","last_peered":"2024-04-15T23:35:16.297308+0000","last_clean":"2024-04-15T23:35:16.297308+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:35:16.297308+0000","last_undegraded":"2024-04-15T23:35:16.297308+0000","last_fullsized":"2024-04-15T23:35:16.297308+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":470,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296977+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:35:16.296977+0000","last_peered":"2024-04-15T23:35:16.296977+0000","last_clean":"2024-04-15T23:35:16.296977+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:35:16.296977+0000","last_undegraded":"2024-04-15T23:35:16.296977+0000","last_fullsized":"2024-04-15T23:35:16.296977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":288,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294338+0000","last_change":"2024-04-15T23:31:30.880822+0000","last_active":"2024-04-15T23:35:16.294338+0000","last_peered":"2024-04-15T23:35:16.294338+0000","last_clean":"2024-04-15T23:35:16.294338+0000","last_became_active":"2024-04-15T23:31:30.880187+0000","last_became_peered":"2024-04-15T23:31:30.880187+0000","last_unstale":"2024-04-15T23:35:16.294338+0000","last_undegraded":"2024-04-15T23:35:16.294338+0000","last_fullsized":"2024-04-15T23:35:16.294338+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:27:29.986349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":426,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294229+0000","last_change":"2024-04-15T23:35:14.302748+0000","last_active":"2024-04-15T23:35:16.294229+0000","last_peered":"2024-04-15T23:35:16.294229+0000","last_clean":"2024-04-15T23:35:16.294229+0000","last_became_active":"2024-04-15T23:35:14.302177+0000","last_became_peered":"2024-04-15T23:35:14.302177+0000","last_unstale":"2024-04-15T23:35:16.294229+0000","last_undegraded":"2024-04-15T23:35:16.294229+0000","last_fullsized":"2024-04-15T23:35:16.294229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:48:57.887314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":84,"num_bytes_recovered":139423,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":545,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296899+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:35:16.296899+0000","last_peered":"2024-04-15T23:35:16.296899+0000","last_clean":"2024-04-15T23:35:16.296899+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:35:16.296899+0000","last_undegraded":"2024-04-15T23:35:16.296899+0000","last_fullsized":"2024-04-15T23:35:16.296899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":519,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294073+0000","last_change":"2024-04-15T23:35:13.303626+0000","last_active":"2024-04-15T23:35:16.294073+0000","last_peered":"2024-04-15T23:35:16.294073+0000","last_clean":"2024-04-15T23:35:16.294073+0000","last_became_active":"2024-04-15T23:35:13.303020+0000","last_became_peered":"2024-04-15T23:35:13.303020+0000","last_unstale":"2024-04-15T23:35:16.294073+0000","last_undegraded":"2024-04-15T23:35:16.294073+0000","last_fullsized":"2024-04-15T23:35:16.294073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:36.526930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":182889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":514,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294127+0000","last_change":"2024-04-15T23:35:11.296974+0000","last_active":"2024-04-15T23:35:16.294127+0000","last_peered":"2024-04-15T23:35:16.294127+0000","last_clean":"2024-04-15T23:35:16.294127+0000","last_became_active":"2024-04-15T23:35:11.296148+0000","last_became_peered":"2024-04-15T23:35:11.296148+0000","last_unstale":"2024-04-15T23:35:16.294127+0000","last_undegraded":"2024-04-15T23:35:16.294127+0000","last_fullsized":"2024-04-15T23:35:16.294127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:54:02.940157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":274228,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":445,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293838+0000","last_change":"2024-04-15T23:35:12.299337+0000","last_active":"2024-04-15T23:35:16.293838+0000","last_peered":"2024-04-15T23:35:16.293838+0000","last_clean":"2024-04-15T23:35:16.293838+0000","last_became_active":"2024-04-15T23:35:12.298132+0000","last_became_peered":"2024-04-15T23:35:12.298132+0000","last_unstale":"2024-04-15T23:35:16.293838+0000","last_undegraded":"2024-04-15T23:35:16.293838+0000","last_fullsized":"2024-04-15T23:35:16.293838+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:56:07.706157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":86,"num_bytes_recovered":98254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":256,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294737+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:35:16.294737+0000","last_peered":"2024-04-15T23:35:16.294737+0000","last_clean":"2024-04-15T23:35:16.294737+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:35:16.294737+0000","last_undegraded":"2024-04-15T23:35:16.294737+0000","last_fullsized":"2024-04-15T23:35:16.294737+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":468,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.298718+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:35:16.298718+0000","last_peered":"2024-04-15T23:35:16.298718+0000","last_clean":"2024-04-15T23:35:16.298718+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:35:16.298718+0000","last_undegraded":"2024-04-15T23:35:16.298718+0000","last_fullsized":"2024-04-15T23:35:16.298718+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":483,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294414+0000","last_change":"2024-04-15T23:35:10.294609+0000","last_active":"2024-04-15T23:35:16.294414+0000","last_peered":"2024-04-15T23:35:16.294414+0000","last_clean":"2024-04-15T23:35:16.294414+0000","last_became_active":"2024-04-15T23:35:10.294222+0000","last_became_peered":"2024-04-15T23:35:10.294222+0000","last_unstale":"2024-04-15T23:35:16.294414+0000","last_undegraded":"2024-04-15T23:35:16.294414+0000","last_fullsized":"2024-04-15T23:35:16.294414+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":192323,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":260,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296794+0000","last_change":"2024-04-15T23:31:30.882010+0000","last_active":"2024-04-15T23:35:16.296794+0000","last_peered":"2024-04-15T23:35:16.296794+0000","last_clean":"2024-04-15T23:35:16.296794+0000","last_became_active":"2024-04-15T23:31:30.881712+0000","last_became_peered":"2024-04-15T23:31:30.881712+0000","last_unstale":"2024-04-15T23:35:16.296794+0000","last_undegraded":"2024-04-15T23:35:16.296794+0000","last_fullsized":"2024-04-15T23:35:16.296794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:00.090327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":439,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296781+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:35:16.296781+0000","last_peered":"2024-04-15T23:35:16.296781+0000","last_clean":"2024-04-15T23:35:16.296781+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:35:16.296781+0000","last_undegraded":"2024-04-15T23:35:16.296781+0000","last_fullsized":"2024-04-15T23:35:16.296781+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":296,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294124+0000","last_change":"2024-04-15T23:31:30.876155+0000","last_active":"2024-04-15T23:35:16.294124+0000","last_peered":"2024-04-15T23:35:16.294124+0000","last_clean":"2024-04-15T23:35:16.294124+0000","last_became_active":"2024-04-15T23:31:30.875418+0000","last_became_peered":"2024-04-15T23:31:30.875418+0000","last_unstale":"2024-04-15T23:35:16.294124+0000","last_undegraded":"2024-04-15T23:35:16.294124+0000","last_fullsized":"2024-04-15T23:35:16.294124+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:39:30.721252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":276,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294125+0000","last_change":"2024-04-15T23:31:30.875806+0000","last_active":"2024-04-15T23:35:16.294125+0000","last_peered":"2024-04-15T23:35:16.294125+0000","last_clean":"2024-04-15T23:35:16.294125+0000","last_became_active":"2024-04-15T23:31:30.875269+0000","last_became_peered":"2024-04-15T23:31:30.875269+0000","last_unstale":"2024-04-15T23:35:16.294125+0000","last_undegraded":"2024-04-15T23:35:16.294125+0000","last_fullsized":"2024-04-15T23:35:16.294125+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:10:35.322970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":531,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293887+0000","last_change":"2024-04-15T23:35:12.299129+0000","last_active":"2024-04-15T23:35:16.293887+0000","last_peered":"2024-04-15T23:35:16.293887+0000","last_clean":"2024-04-15T23:35:16.293887+0000","last_became_active":"2024-04-15T23:35:12.298025+0000","last_became_peered":"2024-04-15T23:35:12.298025+0000","last_unstale":"2024-04-15T23:35:16.293887+0000","last_undegraded":"2024-04-15T23:35:16.293887+0000","last_fullsized":"2024-04-15T23:35:16.293887+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:08:47.490499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":1487227,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":256,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294602+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:35:16.294602+0000","last_peered":"2024-04-15T23:35:16.294602+0000","last_clean":"2024-04-15T23:35:16.294602+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:35:16.294602+0000","last_undegraded":"2024-04-15T23:35:16.294602+0000","last_fullsized":"2024-04-15T23:35:16.294602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":468,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.299556+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:35:16.299556+0000","last_peered":"2024-04-15T23:35:16.299556+0000","last_clean":"2024-04-15T23:35:16.299556+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:35:16.299556+0000","last_undegraded":"2024-04-15T23:35:16.299556+0000","last_fullsized":"2024-04-15T23:35:16.299556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":229,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.299118+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:35:16.299118+0000","last_peered":"2024-04-15T23:35:16.299118+0000","last_clean":"2024-04-15T23:35:16.299118+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:35:16.299118+0000","last_undegraded":"2024-04-15T23:35:16.299118+0000","last_fullsized":"2024-04-15T23:35:16.299118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":548,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294968+0000","last_change":"2024-04-15T23:35:14.302777+0000","last_active":"2024-04-15T23:35:16.294968+0000","last_peered":"2024-04-15T23:35:16.294968+0000","last_clean":"2024-04-15T23:35:16.294968+0000","last_became_active":"2024-04-15T23:35:14.302139+0000","last_became_peered":"2024-04-15T23:35:14.302139+0000","last_unstale":"2024-04-15T23:35:16.294968+0000","last_undegraded":"2024-04-15T23:35:16.294968+0000","last_fullsized":"2024-04-15T23:35:16.294968+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:38:40.568884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":244249,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":494,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294551+0000","last_change":"2024-04-15T23:35:15.294938+0000","last_active":"2024-04-15T23:35:16.294551+0000","last_peered":"2024-04-15T23:35:16.294551+0000","last_clean":"2024-04-15T23:35:16.294551+0000","last_became_active":"2024-04-15T23:35:15.294314+0000","last_became_peered":"2024-04-15T23:35:15.294314+0000","last_unstale":"2024-04-15T23:35:16.294551+0000","last_undegraded":"2024-04-15T23:35:16.294551+0000","last_fullsized":"2024-04-15T23:35:16.294551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:10.534536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87443,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":289,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296534+0000","last_change":"2024-04-15T23:31:30.880499+0000","last_active":"2024-04-15T23:35:16.296534+0000","last_peered":"2024-04-15T23:35:16.296534+0000","last_clean":"2024-04-15T23:35:16.296534+0000","last_became_active":"2024-04-15T23:31:30.880059+0000","last_became_peered":"2024-04-15T23:31:30.880059+0000","last_unstale":"2024-04-15T23:35:16.296534+0000","last_undegraded":"2024-04-15T23:35:16.296534+0000","last_fullsized":"2024-04-15T23:35:16.296534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:11:42.888904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":259,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293706+0000","last_change":"2024-04-15T23:35:10.294643+0000","last_active":"2024-04-15T23:35:16.293706+0000","last_peered":"2024-04-15T23:35:16.293706+0000","last_clean":"2024-04-15T23:35:16.293706+0000","last_became_active":"2024-04-15T23:35:10.293497+0000","last_became_peered":"2024-04-15T23:35:10.293497+0000","last_unstale":"2024-04-15T23:35:16.293706+0000","last_undegraded":"2024-04-15T23:35:16.293706+0000","last_fullsized":"2024-04-15T23:35:16.293706+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:12:59.503325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":505,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296046+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:35:16.296046+0000","last_peered":"2024-04-15T23:35:16.296046+0000","last_clean":"2024-04-15T23:35:16.296046+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:35:16.296046+0000","last_undegraded":"2024-04-15T23:35:16.296046+0000","last_fullsized":"2024-04-15T23:35:16.296046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":275,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297311+0000","last_change":"2024-04-15T23:31:30.876032+0000","last_active":"2024-04-15T23:35:16.297311+0000","last_peered":"2024-04-15T23:35:16.297311+0000","last_clean":"2024-04-15T23:35:16.297311+0000","last_became_active":"2024-04-15T23:31:30.875421+0000","last_became_peered":"2024-04-15T23:31:30.875421+0000","last_unstale":"2024-04-15T23:35:16.297311+0000","last_undegraded":"2024-04-15T23:35:16.297311+0000","last_fullsized":"2024-04-15T23:35:16.297311+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":275,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297758+0000","last_change":"2024-04-15T23:35:16.297758+0000","last_active":"2024-04-15T23:35:16.297758+0000","last_peered":"2024-04-15T23:35:16.297758+0000","last_clean":"2024-04-15T23:35:16.297758+0000","last_became_active":"2024-04-15T23:35:16.296315+0000","last_became_peered":"2024-04-15T23:35:16.296315+0000","last_unstale":"2024-04-15T23:35:16.297758+0000","last_undegraded":"2024-04-15T23:35:16.297758+0000","last_fullsized":"2024-04-15T23:35:16.297758+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:53:16.308014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":279,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294665+0000","last_change":"2024-04-15T23:31:30.880801+0000","last_active":"2024-04-15T23:35:16.294665+0000","last_peered":"2024-04-15T23:35:16.294665+0000","last_clean":"2024-04-15T23:35:16.294665+0000","last_became_active":"2024-04-15T23:31:30.879693+0000","last_became_peered":"2024-04-15T23:31:30.879693+0000","last_unstale":"2024-04-15T23:35:16.294665+0000","last_undegraded":"2024-04-15T23:35:16.294665+0000","last_fullsized":"2024-04-15T23:35:16.294665+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:29:27.106114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":270,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297145+0000","last_change":"2024-04-15T23:31:30.876464+0000","last_active":"2024-04-15T23:35:16.297145+0000","last_peered":"2024-04-15T23:35:16.297145+0000","last_clean":"2024-04-15T23:35:16.297145+0000","last_became_active":"2024-04-15T23:31:30.875767+0000","last_became_peered":"2024-04-15T23:31:30.875767+0000","last_unstale":"2024-04-15T23:35:16.297145+0000","last_undegraded":"2024-04-15T23:35:16.297145+0000","last_fullsized":"2024-04-15T23:35:16.297145+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:29.536735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":254,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293837+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:35:16.293837+0000","last_peered":"2024-04-15T23:35:16.293837+0000","last_clean":"2024-04-15T23:35:16.293837+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:35:16.293837+0000","last_undegraded":"2024-04-15T23:35:16.293837+0000","last_fullsized":"2024-04-15T23:35:16.293837+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":312,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296663+0000","last_change":"2024-04-15T23:31:30.879601+0000","last_active":"2024-04-15T23:35:16.296663+0000","last_peered":"2024-04-15T23:35:16.296663+0000","last_clean":"2024-04-15T23:35:16.296663+0000","last_became_active":"2024-04-15T23:31:30.879295+0000","last_became_peered":"2024-04-15T23:31:30.879295+0000","last_unstale":"2024-04-15T23:35:16.296663+0000","last_undegraded":"2024-04-15T23:35:16.296663+0000","last_fullsized":"2024-04-15T23:35:16.296663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:52:29.467309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":283,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294010+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:35:16.294010+0000","last_peered":"2024-04-15T23:35:16.294010+0000","last_clean":"2024-04-15T23:35:16.294010+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:35:16.294010+0000","last_undegraded":"2024-04-15T23:35:16.294010+0000","last_fullsized":"2024-04-15T23:35:16.294010+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":543,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294323+0000","last_change":"2024-04-15T23:35:11.297293+0000","last_active":"2024-04-15T23:35:16.294323+0000","last_peered":"2024-04-15T23:35:16.294323+0000","last_clean":"2024-04-15T23:35:16.294323+0000","last_became_active":"2024-04-15T23:35:11.296756+0000","last_became_peered":"2024-04-15T23:35:11.296756+0000","last_unstale":"2024-04-15T23:35:16.294323+0000","last_undegraded":"2024-04-15T23:35:16.294323+0000","last_fullsized":"2024-04-15T23:35:16.294323+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:58:45.896248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":127328,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":469,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296966+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:35:16.296966+0000","last_peered":"2024-04-15T23:35:16.296966+0000","last_clean":"2024-04-15T23:35:16.296966+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:35:16.296966+0000","last_undegraded":"2024-04-15T23:35:16.296966+0000","last_fullsized":"2024-04-15T23:35:16.296966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":266,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294582+0000","last_change":"2024-04-15T23:35:10.294028+0000","last_active":"2024-04-15T23:35:16.294582+0000","last_peered":"2024-04-15T23:35:16.294582+0000","last_clean":"2024-04-15T23:35:16.294582+0000","last_became_active":"2024-04-15T23:35:10.293804+0000","last_became_peered":"2024-04-15T23:35:10.293804+0000","last_unstale":"2024-04-15T23:35:16.294582+0000","last_undegraded":"2024-04-15T23:35:16.294582+0000","last_fullsized":"2024-04-15T23:35:16.294582+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:14.050412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":3518792,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":468,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297327+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:35:16.297327+0000","last_peered":"2024-04-15T23:35:16.297327+0000","last_clean":"2024-04-15T23:35:16.297327+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:35:16.297327+0000","last_undegraded":"2024-04-15T23:35:16.297327+0000","last_fullsized":"2024-04-15T23:35:16.297327+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293752+0000","last_change":"2024-04-15T23:35:07.923327+0000","last_active":"2024-04-15T23:35:16.293752+0000","last_peered":"2024-04-15T23:35:16.293752+0000","last_clean":"2024-04-15T23:35:16.293752+0000","last_became_active":"2024-04-15T23:35:07.923022+0000","last_became_peered":"2024-04-15T23:35:07.923022+0000","last_unstale":"2024-04-15T23:35:16.293752+0000","last_undegraded":"2024-04-15T23:35:16.293752+0000","last_fullsized":"2024-04-15T23:35:16.293752+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:00:56.197588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":279,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294370+0000","last_change":"2024-04-15T23:35:15.296797+0000","last_active":"2024-04-15T23:35:16.294370+0000","last_peered":"2024-04-15T23:35:16.294370+0000","last_clean":"2024-04-15T23:35:16.294370+0000","last_became_active":"2024-04-15T23:35:15.295475+0000","last_became_peered":"2024-04-15T23:35:15.295475+0000","last_unstale":"2024-04-15T23:35:16.294370+0000","last_undegraded":"2024-04-15T23:35:16.294370+0000","last_fullsized":"2024-04-15T23:35:16.294370+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:57:52.563741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":121,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296336+0000","last_change":"2024-04-15T23:31:29.875257+0000","last_active":"2024-04-15T23:35:16.296336+0000","last_peered":"2024-04-15T23:35:16.296336+0000","last_clean":"2024-04-15T23:35:16.296336+0000","last_became_active":"2024-04-15T23:31:29.874571+0000","last_became_peered":"2024-04-15T23:31:29.874571+0000","last_unstale":"2024-04-15T23:35:16.296336+0000","last_undegraded":"2024-04-15T23:35:16.296336+0000","last_fullsized":"2024-04-15T23:35:16.296336+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:07:13.903138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":269,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294453+0000","last_change":"2024-04-15T23:35:13.304246+0000","last_active":"2024-04-15T23:35:16.294453+0000","last_peered":"2024-04-15T23:35:16.294453+0000","last_clean":"2024-04-15T23:35:16.294453+0000","last_became_active":"2024-04-15T23:35:13.303224+0000","last_became_peered":"2024-04-15T23:35:13.303224+0000","last_unstale":"2024-04-15T23:35:16.294453+0000","last_undegraded":"2024-04-15T23:35:16.294453+0000","last_fullsized":"2024-04-15T23:35:16.294453+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:34:12.292741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":130,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294198+0000","last_change":"2024-04-15T23:31:29.876243+0000","last_active":"2024-04-15T23:35:16.294198+0000","last_peered":"2024-04-15T23:35:16.294198+0000","last_clean":"2024-04-15T23:35:16.294198+0000","last_became_active":"2024-04-15T23:31:29.875985+0000","last_became_peered":"2024-04-15T23:31:29.875985+0000","last_unstale":"2024-04-15T23:35:16.294198+0000","last_undegraded":"2024-04-15T23:35:16.294198+0000","last_fullsized":"2024-04-15T23:35:16.294198+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:58:10.641700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294781+0000","last_change":"2024-04-15T23:31:29.875147+0000","last_active":"2024-04-15T23:35:16.294781+0000","last_peered":"2024-04-15T23:35:16.294781+0000","last_clean":"2024-04-15T23:35:16.294781+0000","last_became_active":"2024-04-15T23:31:29.874739+0000","last_became_peered":"2024-04-15T23:31:29.874739+0000","last_unstale":"2024-04-15T23:35:16.294781+0000","last_undegraded":"2024-04-15T23:35:16.294781+0000","last_fullsized":"2024-04-15T23:35:16.294781+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:05.097862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":272,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296065+0000","last_change":"2024-04-15T23:31:30.879898+0000","last_active":"2024-04-15T23:35:16.296065+0000","last_peered":"2024-04-15T23:35:16.296065+0000","last_clean":"2024-04-15T23:35:16.296065+0000","last_became_active":"2024-04-15T23:31:30.879595+0000","last_became_peered":"2024-04-15T23:31:30.879595+0000","last_unstale":"2024-04-15T23:35:16.296065+0000","last_undegraded":"2024-04-15T23:35:16.296065+0000","last_fullsized":"2024-04-15T23:35:16.296065+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:38:26.183396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":124,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297358+0000","last_change":"2024-04-15T23:31:29.872550+0000","last_active":"2024-04-15T23:35:16.297358+0000","last_peered":"2024-04-15T23:35:16.297358+0000","last_clean":"2024-04-15T23:35:16.297358+0000","last_became_active":"2024-04-15T23:31:29.871405+0000","last_became_peered":"2024-04-15T23:31:29.871405+0000","last_unstale":"2024-04-15T23:35:16.297358+0000","last_undegraded":"2024-04-15T23:35:16.297358+0000","last_fullsized":"2024-04-15T23:35:16.297358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:35.920869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":542,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296198+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:35:16.296198+0000","last_peered":"2024-04-15T23:35:16.296198+0000","last_clean":"2024-04-15T23:35:16.296198+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:35:16.296198+0000","last_undegraded":"2024-04-15T23:35:16.296198+0000","last_fullsized":"2024-04-15T23:35:16.296198+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295072+0000","last_change":"2024-04-15T23:31:29.875582+0000","last_active":"2024-04-15T23:35:16.295072+0000","last_peered":"2024-04-15T23:35:16.295072+0000","last_clean":"2024-04-15T23:35:16.295072+0000","last_became_active":"2024-04-15T23:31:29.875229+0000","last_became_peered":"2024-04-15T23:31:29.875229+0000","last_unstale":"2024-04-15T23:35:16.295072+0000","last_undegraded":"2024-04-15T23:35:16.295072+0000","last_fullsized":"2024-04-15T23:35:16.295072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:49:34.704885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":473,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294354+0000","last_change":"2024-04-15T23:35:13.300527+0000","last_active":"2024-04-15T23:35:16.294354+0000","last_peered":"2024-04-15T23:35:16.294354+0000","last_clean":"2024-04-15T23:35:16.294354+0000","last_became_active":"2024-04-15T23:35:13.300095+0000","last_became_peered":"2024-04-15T23:35:13.300095+0000","last_unstale":"2024-04-15T23:35:16.294354+0000","last_undegraded":"2024-04-15T23:35:16.294354+0000","last_fullsized":"2024-04-15T23:35:16.294354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:15:44.585807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":66508,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":129,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295224+0000","last_change":"2024-04-15T23:35:07.923940+0000","last_active":"2024-04-15T23:35:16.295224+0000","last_peered":"2024-04-15T23:35:16.295224+0000","last_clean":"2024-04-15T23:35:16.295224+0000","last_became_active":"2024-04-15T23:35:07.923559+0000","last_became_peered":"2024-04-15T23:35:07.923559+0000","last_unstale":"2024-04-15T23:35:16.295224+0000","last_undegraded":"2024-04-15T23:35:16.295224+0000","last_fullsized":"2024-04-15T23:35:16.295224+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:34.992257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":245,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294561+0000","last_change":"2024-04-15T23:35:14.303298+0000","last_active":"2024-04-15T23:35:16.294561+0000","last_peered":"2024-04-15T23:35:16.294561+0000","last_clean":"2024-04-15T23:35:16.294561+0000","last_became_active":"2024-04-15T23:35:14.302372+0000","last_became_peered":"2024-04-15T23:35:14.302372+0000","last_unstale":"2024-04-15T23:35:16.294561+0000","last_undegraded":"2024-04-15T23:35:16.294561+0000","last_fullsized":"2024-04-15T23:35:16.294561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:27.003926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":46,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294142+0000","last_change":"2024-04-15T23:35:07.979404+0000","last_active":"2024-04-15T23:35:16.294142+0000","last_peered":"2024-04-15T23:35:16.294142+0000","last_clean":"2024-04-15T23:35:16.294142+0000","last_became_active":"2024-04-15T23:35:07.924742+0000","last_became_peered":"2024-04-15T23:35:07.924742+0000","last_unstale":"2024-04-15T23:35:16.294142+0000","last_undegraded":"2024-04-15T23:35:16.294142+0000","last_fullsized":"2024-04-15T23:35:16.294142+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:59.503975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":540,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295036+0000","last_change":"2024-04-15T23:35:15.295761+0000","last_active":"2024-04-15T23:35:16.295036+0000","last_peered":"2024-04-15T23:35:16.295036+0000","last_clean":"2024-04-15T23:35:16.295036+0000","last_became_active":"2024-04-15T23:35:15.295171+0000","last_became_peered":"2024-04-15T23:35:15.295171+0000","last_unstale":"2024-04-15T23:35:16.295036+0000","last_undegraded":"2024-04-15T23:35:16.295036+0000","last_fullsized":"2024-04-15T23:35:16.295036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:40:10.410107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":115,"num_bytes_recovered":91970,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":128,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294606+0000","last_change":"2024-04-15T23:35:07.919642+0000","last_active":"2024-04-15T23:35:16.294606+0000","last_peered":"2024-04-15T23:35:16.294606+0000","last_clean":"2024-04-15T23:35:16.294606+0000","last_became_active":"2024-04-15T23:35:07.919354+0000","last_became_peered":"2024-04-15T23:35:07.919354+0000","last_unstale":"2024-04-15T23:35:16.294606+0000","last_undegraded":"2024-04-15T23:35:16.294606+0000","last_fullsized":"2024-04-15T23:35:16.294606+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:24.197568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":285,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294914+0000","last_change":"2024-04-15T23:31:30.880522+0000","last_active":"2024-04-15T23:35:16.294914+0000","last_peered":"2024-04-15T23:35:16.294914+0000","last_clean":"2024-04-15T23:35:16.294914+0000","last_became_active":"2024-04-15T23:31:30.878194+0000","last_became_peered":"2024-04-15T23:31:30.878194+0000","last_unstale":"2024-04-15T23:35:16.294914+0000","last_undegraded":"2024-04-15T23:35:16.294914+0000","last_fullsized":"2024-04-15T23:35:16.294914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:17:13.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":121,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296475+0000","last_change":"2024-04-15T23:31:29.875073+0000","last_active":"2024-04-15T23:35:16.296475+0000","last_peered":"2024-04-15T23:35:16.296475+0000","last_clean":"2024-04-15T23:35:16.296475+0000","last_became_active":"2024-04-15T23:31:29.874204+0000","last_became_peered":"2024-04-15T23:31:29.874204+0000","last_unstale":"2024-04-15T23:35:16.296475+0000","last_undegraded":"2024-04-15T23:35:16.296475+0000","last_fullsized":"2024-04-15T23:35:16.296475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:24:10.171294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":257,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294893+0000","last_change":"2024-04-15T23:31:30.878266+0000","last_active":"2024-04-15T23:35:16.294893+0000","last_peered":"2024-04-15T23:35:16.294893+0000","last_clean":"2024-04-15T23:35:16.294893+0000","last_became_active":"2024-04-15T23:31:30.877545+0000","last_became_peered":"2024-04-15T23:31:30.877545+0000","last_unstale":"2024-04-15T23:35:16.294893+0000","last_undegraded":"2024-04-15T23:35:16.294893+0000","last_fullsized":"2024-04-15T23:35:16.294893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:36:37.421491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":129,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296211+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:35:16.296211+0000","last_peered":"2024-04-15T23:35:16.296211+0000","last_clean":"2024-04-15T23:35:16.296211+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:35:16.296211+0000","last_undegraded":"2024-04-15T23:35:16.296211+0000","last_fullsized":"2024-04-15T23:35:16.296211+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":236,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294956+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:35:16.294956+0000","last_peered":"2024-04-15T23:35:16.294956+0000","last_clean":"2024-04-15T23:35:16.294956+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:35:16.294956+0000","last_undegraded":"2024-04-15T23:35:16.294956+0000","last_fullsized":"2024-04-15T23:35:16.294956+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":323,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294753+0000","last_change":"2024-04-15T23:31:25.588060+0000","last_active":"2024-04-15T23:35:16.294753+0000","last_peered":"2024-04-15T23:35:16.294753+0000","last_clean":"2024-04-15T23:35:16.294753+0000","last_became_active":"2024-04-15T23:31:25.587588+0000","last_became_peered":"2024-04-15T23:31:25.587588+0000","last_unstale":"2024-04-15T23:35:16.294753+0000","last_undegraded":"2024-04-15T23:35:16.294753+0000","last_fullsized":"2024-04-15T23:35:16.294753+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:54:09.384487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":134,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294890+0000","last_change":"2024-04-15T23:35:07.919572+0000","last_active":"2024-04-15T23:35:16.294890+0000","last_peered":"2024-04-15T23:35:16.294890+0000","last_clean":"2024-04-15T23:35:16.294890+0000","last_became_active":"2024-04-15T23:35:07.919258+0000","last_became_peered":"2024-04-15T23:35:07.919258+0000","last_unstale":"2024-04-15T23:35:16.294890+0000","last_undegraded":"2024-04-15T23:35:16.294890+0000","last_fullsized":"2024-04-15T23:35:16.294890+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:56.248931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294027+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:35:16.294027+0000","last_peered":"2024-04-15T23:35:16.294027+0000","last_clean":"2024-04-15T23:35:16.294027+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:35:16.294027+0000","last_undegraded":"2024-04-15T23:35:16.294027+0000","last_fullsized":"2024-04-15T23:35:16.294027+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":270,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294925+0000","last_change":"2024-04-15T23:31:30.880517+0000","last_active":"2024-04-15T23:35:16.294925+0000","last_peered":"2024-04-15T23:35:16.294925+0000","last_clean":"2024-04-15T23:35:16.294925+0000","last_became_active":"2024-04-15T23:31:30.878616+0000","last_became_peered":"2024-04-15T23:31:30.878616+0000","last_unstale":"2024-04-15T23:35:16.294925+0000","last_undegraded":"2024-04-15T23:35:16.294925+0000","last_fullsized":"2024-04-15T23:35:16.294925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:13.266527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":127,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294805+0000","last_change":"2024-04-15T23:31:25.587978+0000","last_active":"2024-04-15T23:35:16.294805+0000","last_peered":"2024-04-15T23:35:16.294805+0000","last_clean":"2024-04-15T23:35:16.294805+0000","last_became_active":"2024-04-15T23:31:25.587662+0000","last_became_peered":"2024-04-15T23:31:25.587662+0000","last_unstale":"2024-04-15T23:35:16.294805+0000","last_undegraded":"2024-04-15T23:35:16.294805+0000","last_fullsized":"2024-04-15T23:35:16.294805+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:23:21.540570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":42,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293629+0000","last_change":"2024-04-15T23:35:07.935306+0000","last_active":"2024-04-15T23:35:16.293629+0000","last_peered":"2024-04-15T23:35:16.293629+0000","last_clean":"2024-04-15T23:35:16.293629+0000","last_became_active":"2024-04-15T23:35:07.919625+0000","last_became_peered":"2024-04-15T23:35:07.919625+0000","last_unstale":"2024-04-15T23:35:16.293629+0000","last_undegraded":"2024-04-15T23:35:16.293629+0000","last_fullsized":"2024-04-15T23:35:16.293629+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:49:44.043170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":497,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297160+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:35:16.297160+0000","last_peered":"2024-04-15T23:35:16.297160+0000","last_clean":"2024-04-15T23:35:16.297160+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:35:16.297160+0000","last_undegraded":"2024-04-15T23:35:16.297160+0000","last_fullsized":"2024-04-15T23:35:16.297160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293956+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:35:16.293956+0000","last_peered":"2024-04-15T23:35:16.293956+0000","last_clean":"2024-04-15T23:35:16.293956+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:35:16.293956+0000","last_undegraded":"2024-04-15T23:35:16.293956+0000","last_fullsized":"2024-04-15T23:35:16.293956+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":177,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296238+0000","last_change":"2024-04-15T23:31:29.875020+0000","last_active":"2024-04-15T23:35:16.296238+0000","last_peered":"2024-04-15T23:35:16.296238+0000","last_clean":"2024-04-15T23:35:16.296238+0000","last_became_active":"2024-04-15T23:31:29.872938+0000","last_became_peered":"2024-04-15T23:31:29.872938+0000","last_unstale":"2024-04-15T23:35:16.296238+0000","last_undegraded":"2024-04-15T23:35:16.296238+0000","last_fullsized":"2024-04-15T23:35:16.296238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:58.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":257,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294942+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:35:16.294942+0000","last_peered":"2024-04-15T23:35:16.294942+0000","last_clean":"2024-04-15T23:35:16.294942+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:35:16.294942+0000","last_undegraded":"2024-04-15T23:35:16.294942+0000","last_fullsized":"2024-04-15T23:35:16.294942+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294794+0000","last_change":"2024-04-15T23:35:07.919852+0000","last_active":"2024-04-15T23:35:16.294794+0000","last_peered":"2024-04-15T23:35:16.294794+0000","last_clean":"2024-04-15T23:35:16.294794+0000","last_became_active":"2024-04-15T23:35:07.919642+0000","last_became_peered":"2024-04-15T23:35:07.919642+0000","last_unstale":"2024-04-15T23:35:16.294794+0000","last_undegraded":"2024-04-15T23:35:16.294794+0000","last_fullsized":"2024-04-15T23:35:16.294794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:53:29.682287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":128,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294657+0000","last_change":"2024-04-15T23:35:07.923775+0000","last_active":"2024-04-15T23:35:16.294657+0000","last_peered":"2024-04-15T23:35:16.294657+0000","last_clean":"2024-04-15T23:35:16.294657+0000","last_became_active":"2024-04-15T23:35:07.923310+0000","last_became_peered":"2024-04-15T23:35:07.923310+0000","last_unstale":"2024-04-15T23:35:16.294657+0000","last_undegraded":"2024-04-15T23:35:16.294657+0000","last_fullsized":"2024-04-15T23:35:16.294657+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:44.456832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":246,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294128+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:35:16.294128+0000","last_peered":"2024-04-15T23:35:16.294128+0000","last_clean":"2024-04-15T23:35:16.294128+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:35:16.294128+0000","last_undegraded":"2024-04-15T23:35:16.294128+0000","last_fullsized":"2024-04-15T23:35:16.294128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":128,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295074+0000","last_change":"2024-04-15T23:35:07.919638+0000","last_active":"2024-04-15T23:35:16.295074+0000","last_peered":"2024-04-15T23:35:16.295074+0000","last_clean":"2024-04-15T23:35:16.295074+0000","last_became_active":"2024-04-15T23:35:07.919325+0000","last_became_peered":"2024-04-15T23:35:07.919325+0000","last_unstale":"2024-04-15T23:35:16.295074+0000","last_undegraded":"2024-04-15T23:35:16.295074+0000","last_fullsized":"2024-04-15T23:35:16.295074+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:20.779700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294076+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:35:16.294076+0000","last_peered":"2024-04-15T23:35:16.294076+0000","last_clean":"2024-04-15T23:35:16.294076+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:35:16.294076+0000","last_undegraded":"2024-04-15T23:35:16.294076+0000","last_fullsized":"2024-04-15T23:35:16.294076+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":330,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296561+0000","last_change":"2024-04-15T23:31:30.879368+0000","last_active":"2024-04-15T23:35:16.296561+0000","last_peered":"2024-04-15T23:35:16.296561+0000","last_clean":"2024-04-15T23:35:16.296561+0000","last_became_active":"2024-04-15T23:31:30.879035+0000","last_became_peered":"2024-04-15T23:31:30.879035+0000","last_unstale":"2024-04-15T23:35:16.296561+0000","last_undegraded":"2024-04-15T23:35:16.296561+0000","last_fullsized":"2024-04-15T23:35:16.296561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:44:56.901881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294350+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:35:16.294350+0000","last_peered":"2024-04-15T23:35:16.294350+0000","last_clean":"2024-04-15T23:35:16.294350+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:35:16.294350+0000","last_undegraded":"2024-04-15T23:35:16.294350+0000","last_fullsized":"2024-04-15T23:35:16.294350+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":134,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297618+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:35:16.297618+0000","last_peered":"2024-04-15T23:35:16.297618+0000","last_clean":"2024-04-15T23:35:16.297618+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:35:16.297618+0000","last_undegraded":"2024-04-15T23:35:16.297618+0000","last_fullsized":"2024-04-15T23:35:16.297618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":299,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296762+0000","last_change":"2024-04-15T23:31:30.881405+0000","last_active":"2024-04-15T23:35:16.296762+0000","last_peered":"2024-04-15T23:35:16.296762+0000","last_clean":"2024-04-15T23:35:16.296762+0000","last_became_active":"2024-04-15T23:31:30.881037+0000","last_became_peered":"2024-04-15T23:31:30.881037+0000","last_unstale":"2024-04-15T23:35:16.296762+0000","last_undegraded":"2024-04-15T23:35:16.296762+0000","last_fullsized":"2024-04-15T23:35:16.296762+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:41:40.047879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":42,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294501+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:35:16.294501+0000","last_peered":"2024-04-15T23:35:16.294501+0000","last_clean":"2024-04-15T23:35:16.294501+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:35:16.294501+0000","last_undegraded":"2024-04-15T23:35:16.294501+0000","last_fullsized":"2024-04-15T23:35:16.294501+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294243+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:35:16.294243+0000","last_peered":"2024-04-15T23:35:16.294243+0000","last_clean":"2024-04-15T23:35:16.294243+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:35:16.294243+0000","last_undegraded":"2024-04-15T23:35:16.294243+0000","last_fullsized":"2024-04-15T23:35:16.294243+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":246,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293813+0000","last_change":"2024-04-15T23:35:13.304044+0000","last_active":"2024-04-15T23:35:16.293813+0000","last_peered":"2024-04-15T23:35:16.293813+0000","last_clean":"2024-04-15T23:35:16.293813+0000","last_became_active":"2024-04-15T23:35:13.303268+0000","last_became_peered":"2024-04-15T23:35:13.303268+0000","last_unstale":"2024-04-15T23:35:16.293813+0000","last_undegraded":"2024-04-15T23:35:16.293813+0000","last_fullsized":"2024-04-15T23:35:16.293813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:46.714929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":57,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294380+0000","last_change":"2024-04-15T23:35:07.961077+0000","last_active":"2024-04-15T23:35:16.294380+0000","last_peered":"2024-04-15T23:35:16.294380+0000","last_clean":"2024-04-15T23:35:16.294380+0000","last_became_active":"2024-04-15T23:35:07.924404+0000","last_became_peered":"2024-04-15T23:35:07.924404+0000","last_unstale":"2024-04-15T23:35:16.294380+0000","last_undegraded":"2024-04-15T23:35:16.294380+0000","last_fullsized":"2024-04-15T23:35:16.294380+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:26.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":127,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294857+0000","last_change":"2024-04-15T23:31:25.587153+0000","last_active":"2024-04-15T23:35:16.294857+0000","last_peered":"2024-04-15T23:35:16.294857+0000","last_clean":"2024-04-15T23:35:16.294857+0000","last_became_active":"2024-04-15T23:31:25.586894+0000","last_became_peered":"2024-04-15T23:31:25.586894+0000","last_unstale":"2024-04-15T23:35:16.294857+0000","last_undegraded":"2024-04-15T23:35:16.294857+0000","last_fullsized":"2024-04-15T23:35:16.294857+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:57:09.702759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":261,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296295+0000","last_change":"2024-04-15T23:31:30.874494+0000","last_active":"2024-04-15T23:35:16.296295+0000","last_peered":"2024-04-15T23:35:16.296295+0000","last_clean":"2024-04-15T23:35:16.296295+0000","last_became_active":"2024-04-15T23:31:30.873979+0000","last_became_peered":"2024-04-15T23:31:30.873979+0000","last_unstale":"2024-04-15T23:35:16.296295+0000","last_undegraded":"2024-04-15T23:35:16.296295+0000","last_fullsized":"2024-04-15T23:35:16.296295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:02:03.580342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":274,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294220+0000","last_change":"2024-04-15T23:31:30.879569+0000","last_active":"2024-04-15T23:35:16.294220+0000","last_peered":"2024-04-15T23:35:16.294220+0000","last_clean":"2024-04-15T23:35:16.294220+0000","last_became_active":"2024-04-15T23:31:30.878029+0000","last_became_peered":"2024-04-15T23:31:30.878029+0000","last_unstale":"2024-04-15T23:35:16.294220+0000","last_undegraded":"2024-04-15T23:35:16.294220+0000","last_fullsized":"2024-04-15T23:35:16.294220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:56:09.985996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":164,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295126+0000","last_change":"2024-04-15T23:31:29.875323+0000","last_active":"2024-04-15T23:35:16.295126+0000","last_peered":"2024-04-15T23:35:16.295126+0000","last_clean":"2024-04-15T23:35:16.295126+0000","last_became_active":"2024-04-15T23:31:29.874858+0000","last_became_peered":"2024-04-15T23:31:29.874858+0000","last_unstale":"2024-04-15T23:35:16.295126+0000","last_undegraded":"2024-04-15T23:35:16.295126+0000","last_fullsized":"2024-04-15T23:35:16.295126+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:56:00.188523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":240,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293750+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:35:16.293750+0000","last_peered":"2024-04-15T23:35:16.293750+0000","last_clean":"2024-04-15T23:35:16.293750+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:35:16.293750+0000","last_undegraded":"2024-04-15T23:35:16.293750+0000","last_fullsized":"2024-04-15T23:35:16.293750+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":144,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297480+0000","last_change":"2024-04-15T23:31:29.874665+0000","last_active":"2024-04-15T23:35:16.297480+0000","last_peered":"2024-04-15T23:35:16.297480+0000","last_clean":"2024-04-15T23:35:16.297480+0000","last_became_active":"2024-04-15T23:31:29.874125+0000","last_became_peered":"2024-04-15T23:31:29.874125+0000","last_unstale":"2024-04-15T23:35:16.297480+0000","last_undegraded":"2024-04-15T23:35:16.297480+0000","last_fullsized":"2024-04-15T23:35:16.297480+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.170723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":128,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295009+0000","last_change":"2024-04-15T23:35:07.923603+0000","last_active":"2024-04-15T23:35:16.295009+0000","last_peered":"2024-04-15T23:35:16.295009+0000","last_clean":"2024-04-15T23:35:16.295009+0000","last_became_active":"2024-04-15T23:35:07.923069+0000","last_became_peered":"2024-04-15T23:35:07.923069+0000","last_unstale":"2024-04-15T23:35:16.295009+0000","last_undegraded":"2024-04-15T23:35:16.295009+0000","last_fullsized":"2024-04-15T23:35:16.295009+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:39.536190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":269,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293791+0000","last_change":"2024-04-15T23:35:10.295722+0000","last_active":"2024-04-15T23:35:16.293791+0000","last_peered":"2024-04-15T23:35:16.293791+0000","last_clean":"2024-04-15T23:35:16.293791+0000","last_became_active":"2024-04-15T23:35:10.294673+0000","last_became_peered":"2024-04-15T23:35:10.294673+0000","last_unstale":"2024-04-15T23:35:16.293791+0000","last_undegraded":"2024-04-15T23:35:16.293791+0000","last_fullsized":"2024-04-15T23:35:16.293791+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:22:19.610009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294799+0000","last_change":"2024-04-15T23:35:07.923646+0000","last_active":"2024-04-15T23:35:16.294799+0000","last_peered":"2024-04-15T23:35:16.294799+0000","last_clean":"2024-04-15T23:35:16.294799+0000","last_became_active":"2024-04-15T23:35:07.923298+0000","last_became_peered":"2024-04-15T23:35:07.923298+0000","last_unstale":"2024-04-15T23:35:16.294799+0000","last_undegraded":"2024-04-15T23:35:16.294799+0000","last_fullsized":"2024-04-15T23:35:16.294799+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:01.524255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":256,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293678+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:35:16.293678+0000","last_peered":"2024-04-15T23:35:16.293678+0000","last_clean":"2024-04-15T23:35:16.293678+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:35:16.293678+0000","last_undegraded":"2024-04-15T23:35:16.293678+0000","last_fullsized":"2024-04-15T23:35:16.293678+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":290,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297471+0000","last_change":"2024-04-15T23:31:30.875733+0000","last_active":"2024-04-15T23:35:16.297471+0000","last_peered":"2024-04-15T23:35:16.297471+0000","last_clean":"2024-04-15T23:35:16.297471+0000","last_became_active":"2024-04-15T23:31:30.875395+0000","last_became_peered":"2024-04-15T23:31:30.875395+0000","last_unstale":"2024-04-15T23:35:16.297471+0000","last_undegraded":"2024-04-15T23:35:16.297471+0000","last_fullsized":"2024-04-15T23:35:16.297471+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:28.325871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293479+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:35:16.293479+0000","last_peered":"2024-04-15T23:35:16.293479+0000","last_clean":"2024-04-15T23:35:16.293479+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:35:16.293479+0000","last_undegraded":"2024-04-15T23:35:16.293479+0000","last_fullsized":"2024-04-15T23:35:16.293479+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":242,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297556+0000","last_change":"2024-04-15T23:35:16.297556+0000","last_active":"2024-04-15T23:35:16.297556+0000","last_peered":"2024-04-15T23:35:16.297556+0000","last_clean":"2024-04-15T23:35:16.297556+0000","last_became_active":"2024-04-15T23:35:16.295916+0000","last_became_peered":"2024-04-15T23:35:16.295916+0000","last_unstale":"2024-04-15T23:35:16.297556+0000","last_undegraded":"2024-04-15T23:35:16.297556+0000","last_fullsized":"2024-04-15T23:35:16.297556+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:06:36.172812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.293562+0000","last_change":"2024-04-15T23:35:07.917897+0000","last_active":"2024-04-15T23:35:16.293562+0000","last_peered":"2024-04-15T23:35:16.293562+0000","last_clean":"2024-04-15T23:35:16.293562+0000","last_became_active":"2024-04-15T23:35:07.917508+0000","last_became_peered":"2024-04-15T23:35:07.917508+0000","last_unstale":"2024-04-15T23:35:16.293562+0000","last_undegraded":"2024-04-15T23:35:16.293562+0000","last_fullsized":"2024-04-15T23:35:16.293562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:41:58.784211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":267,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296896+0000","last_change":"2024-04-15T23:31:30.879592+0000","last_active":"2024-04-15T23:35:16.296896+0000","last_peered":"2024-04-15T23:35:16.296896+0000","last_clean":"2024-04-15T23:35:16.296896+0000","last_became_active":"2024-04-15T23:31:30.879172+0000","last_became_peered":"2024-04-15T23:31:30.879172+0000","last_unstale":"2024-04-15T23:35:16.296896+0000","last_undegraded":"2024-04-15T23:35:16.296896+0000","last_fullsized":"2024-04-15T23:35:16.296896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:09:59.972464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":135,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296666+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:35:16.296666+0000","last_peered":"2024-04-15T23:35:16.296666+0000","last_clean":"2024-04-15T23:35:16.296666+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:35:16.296666+0000","last_undegraded":"2024-04-15T23:35:16.296666+0000","last_fullsized":"2024-04-15T23:35:16.296666+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":498,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296823+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:35:16.296823+0000","last_peered":"2024-04-15T23:35:16.296823+0000","last_clean":"2024-04-15T23:35:16.296823+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:35:16.296823+0000","last_undegraded":"2024-04-15T23:35:16.296823+0000","last_fullsized":"2024-04-15T23:35:16.296823+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":126,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296990+0000","last_change":"2024-04-15T23:31:29.877080+0000","last_active":"2024-04-15T23:35:16.296990+0000","last_peered":"2024-04-15T23:35:16.296990+0000","last_clean":"2024-04-15T23:35:16.296990+0000","last_became_active":"2024-04-15T23:31:29.876775+0000","last_became_peered":"2024-04-15T23:31:29.876775+0000","last_unstale":"2024-04-15T23:35:16.296990+0000","last_undegraded":"2024-04-15T23:35:16.296990+0000","last_fullsized":"2024-04-15T23:35:16.296990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:48:43.487663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":497,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294150+0000","last_change":"2024-04-15T23:35:14.299648+0000","last_active":"2024-04-15T23:35:16.294150+0000","last_peered":"2024-04-15T23:35:16.294150+0000","last_clean":"2024-04-15T23:35:16.294150+0000","last_became_active":"2024-04-15T23:35:14.299173+0000","last_became_peered":"2024-04-15T23:35:14.299173+0000","last_unstale":"2024-04-15T23:35:16.294150+0000","last_undegraded":"2024-04-15T23:35:16.294150+0000","last_fullsized":"2024-04-15T23:35:16.294150+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:31:40.451058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":111927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":130,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295102+0000","last_change":"2024-04-15T23:35:07.923605+0000","last_active":"2024-04-15T23:35:16.295102+0000","last_peered":"2024-04-15T23:35:16.295102+0000","last_clean":"2024-04-15T23:35:16.295102+0000","last_became_active":"2024-04-15T23:35:07.923048+0000","last_became_peered":"2024-04-15T23:35:07.923048+0000","last_unstale":"2024-04-15T23:35:16.295102+0000","last_undegraded":"2024-04-15T23:35:16.295102+0000","last_fullsized":"2024-04-15T23:35:16.295102+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:24.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":491,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294479+0000","last_change":"2024-04-15T23:35:12.299637+0000","last_active":"2024-04-15T23:35:16.294479+0000","last_peered":"2024-04-15T23:35:16.294479+0000","last_clean":"2024-04-15T23:35:16.294479+0000","last_became_active":"2024-04-15T23:35:12.298564+0000","last_became_peered":"2024-04-15T23:35:12.298564+0000","last_unstale":"2024-04-15T23:35:16.294479+0000","last_undegraded":"2024-04-15T23:35:16.294479+0000","last_fullsized":"2024-04-15T23:35:16.294479+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:45:24.200208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":173945,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":180,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.297333+0000","last_change":"2024-04-15T23:31:29.872760+0000","last_active":"2024-04-15T23:35:16.297333+0000","last_peered":"2024-04-15T23:35:16.297333+0000","last_clean":"2024-04-15T23:35:16.297333+0000","last_became_active":"2024-04-15T23:31:29.872261+0000","last_became_peered":"2024-04-15T23:31:29.872261+0000","last_unstale":"2024-04-15T23:35:16.297333+0000","last_undegraded":"2024-04-15T23:35:16.297333+0000","last_fullsized":"2024-04-15T23:35:16.297333+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:00:06.465049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":509,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.296498+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:35:16.296498+0000","last_peered":"2024-04-15T23:35:16.296498+0000","last_clean":"2024-04-15T23:35:16.296498+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:35:16.296498+0000","last_undegraded":"2024-04-15T23:35:16.296498+0000","last_fullsized":"2024-04-15T23:35:16.296498+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":46,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.295145+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:35:16.295145+0000","last_peered":"2024-04-15T23:35:16.295145+0000","last_clean":"2024-04-15T23:35:16.295145+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:35:16.295145+0000","last_undegraded":"2024-04-15T23:35:16.295145+0000","last_fullsized":"2024-04-15T23:35:16.295145+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":561,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294417+0000","last_change":"2024-04-15T23:35:12.299365+0000","last_active":"2024-04-15T23:35:16.294417+0000","last_peered":"2024-04-15T23:35:16.294417+0000","last_clean":"2024-04-15T23:35:16.294417+0000","last_became_active":"2024-04-15T23:35:12.298555+0000","last_became_peered":"2024-04-15T23:35:12.298555+0000","last_unstale":"2024-04-15T23:35:16.294417+0000","last_undegraded":"2024-04-15T23:35:16.294417+0000","last_fullsized":"2024-04-15T23:35:16.294417+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:43:56.403627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":134131,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":46,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-15T23:35:16.294367+0000","last_change":"2024-04-15T23:35:07.956652+0000","last_active":"2024-04-15T23:35:16.294367+0000","last_peered":"2024-04-15T23:35:16.294367+0000","last_clean":"2024-04-15T23:35:16.294367+0000","last_became_active":"2024-04-15T23:35:07.923145+0000","last_became_peered":"2024-04-15T23:35:07.923145+0000","last_unstale":"2024-04-15T23:35:16.294367+0000","last_undegraded":"2024-04-15T23:35:16.294367+0000","last_fullsized":"2024-04-15T23:35:16.294367+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:50:11.946892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4643,"num_bytes_recovered":18119320,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20623652,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103172,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85328,"kb_used_data":45308,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286512,"statfs":{"total":96636764160,"available":96549388288,"internally_reserved":0,"allocated":46395392,"data_stored":39026561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":8,"seq":34359738419,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83580,"kb_used_data":52400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94288260,"statfs":{"total":96636764160,"available":96551178240,"internally_reserved":0,"allocated":53657600,"data_stored":46890281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88836,"kb_used_data":57656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94283004,"statfs":{"total":96636764160,"available":96545796096,"internally_reserved":0,"allocated":59039744,"data_stored":52130369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:35:22.012 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-15T23:35:22.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-15T23:35:22.013 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2] 2024-04-15T23:35:22.013 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:35:22.013 INFO:teuthology.orchestra.console.smithi115:Power off 2024-04-15T23:35:22.013 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T23:35:22.042 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-04-15T23:35:22.042 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:35:22.069 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:35:26.070 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:35:26.181 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:35:27.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-15T23:35:30.182 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:35:30.293 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:35:33.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2024-04-15T23:35:34.294 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:35:34.408 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-15T23:35:34.510 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-04-15T23:35:39.612 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-15T23:35:39.613 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-04-15T23:35:39.613 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.1 doing powercycle of ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:35:39.613 INFO:teuthology.orchestra.console.smithi115:Power on 2024-04-15T23:35:39.613 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T23:35:39.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~12s 2024-04-15T23:35:39.638 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-04-15T23:35:39.639 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:35:39.662 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-15T23:35:43.664 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:35:43.775 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:35:43.876 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-04-15T23:35:43.978 DEBUG:teuthology.orchestra.console.smithi115:Waiting for login prompt 2024-04-15T23:35:43.978 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi115 2024-04-15T23:35:45.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~17s 2024-04-15T23:35:51.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~23s 2024-04-15T23:35:57.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~29s 2024-04-15T23:36:02.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2024-04-15T23:36:08.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~41s 2024-04-15T23:36:14.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~46s 2024-04-15T23:36:20.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~52s 2024-04-15T23:36:26.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~58s 2024-04-15T23:36:31.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~64s 2024-04-15T23:36:37.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2024-04-15T23:36:43.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2024-04-15T23:36:49.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~81s 2024-04-15T23:36:55.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~87s 2024-04-15T23:37:00.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~93s 2024-04-15T23:37:06.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~99s 2024-04-15T23:37:12.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2024-04-15T23:37:18.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2024-04-15T23:37:24.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~116s 2024-04-15T23:37:29.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~122s 2024-04-15T23:37:35.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~128s 2024-04-15T23:37:41.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~134s 2024-04-15T23:37:45.237 DEBUG:teuthology.orchestra.console.smithi115:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing tel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CE 8F GUID: 00000000 0000 0000 0000 0CC47AD8A544 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.115 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.115 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:ce:8f)... Configuring (net0 0c:c4:7a:8f:ce:8f).... Configuring (net0 0c:c4:7a:8f:ce:8f)..... Configuring (net0 0c:c4:7a:8f:ce:8f)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-438.el9.x86_64) 9  CentOS Stream (5.14.0-361.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9              The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-438.el9.x86_64) 9   CentOS Stream (5.14.0-361.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-438.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Fri Apr 12 13:55:21 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,1152000] BIOS-provided[ 0.000000] B0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eacfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f5f000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.698 MHz processor [ 0.000434] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000438] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000439] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000770] last_pfn = 0x78ead max_arch_pfn = 0x400000000 [ 0.006541] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006549] Using GB pages for direct mapping [ 0.006621] RAMDISK: [mem 0x34356000-0x361a2fff] [ 0.006623] ACPI: Early table checksum verification disabled [ 0.006625] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006628] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.006633] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006637] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006640] ACPI: FACS 0x0000000079D48F80 000040 [ 0.006642] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006644] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006646] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006649] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006651] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006653] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006656] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006658] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006660] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006662] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006665] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006667] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006669] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006672] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006674] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006676] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006678] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006680] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.006681] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.006682] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.006682] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.006683] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.006684] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.006684] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.006685] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.006685] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.006686] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.006687] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.006687] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.006688] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.006688] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.006689] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.006689] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.006690] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.006691] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.006691] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.006692] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.006737] No NUMA configuration found [ 0.006737] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006746] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006940] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006975] Zone ranges: [ 0.006976] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006977] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006978] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006979] Device empty [ 0.006980] Movable zone start for each node [ 0.006982] Early memory node ranges [ 0.006983] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.006984] node 0: [mem 0x0000000000100000-0x0000000078eacfff] [ 0.006985] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006988] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006993] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007028] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011834] On node 0, zone Normal: 29011 pages in unavailable ranges [ 0.011943] ACPI: PM-Timer IO Port: 0x408 [ 0.011952] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011953] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011954] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011954] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011955] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011955] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011956] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011957] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011965] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011970] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011971] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011973] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011976] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011977] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011982] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011983] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.011992] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011993] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.011994] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011995] PM: hibernation: Registered nosave memory: [mem 0x78ead000-0x78f5efff] [ 0.011996] PM: hibernation: Registered nosave memory: [mem 0x78f5f000-0x798acfff] [ 0.011996] PM: hibernation: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.011997] PM: hibernation: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.011997] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011998] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011998] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011999] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012001] Booting paravirtualized kernel on bare hardware [ 0.012003] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016314] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016531] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016556] Fallback order for Node 0: 0 [ 0.016558] Built 1 zonelists, mobility grouping on. Total pages: 8228722 [ 0.016559] Policy zone: Normal [ 0.016560] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016616] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64", will be passed to user space. [ 0.016632] random: crng init done [ 0.018798] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019929] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020175] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020182] software IO TLB: area num 8. [ 0.047812] Memory: 1752188K/33437916K available (16384K kernel code, 5629K rwdata, 11796K rodata, 3932K init, 5900K bss, 987080K reserved, 0K cma-reserved) [ 0.047914] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047922] Kernel/User page tables isolation: enabled [ 0.047944] ftrace: allocating 47003 entries in 184 pages [ 0.066144] ftrace: allocated 184 pages with 4 groups [ 0.066649] Dynamic Preempt: voluntary [ 0.066677] rcu: Preemptible hierarchical RCU implementation. [ 0.066678] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066679] Trampoline variant of Tasks RCU enabled. [ 0.066679] Rude variant of Tasks RCU enabled. [ 0.066680] Tracing variant of Tasks RCU enabled. [ 0.066680] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066681] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069929] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.070090] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070197] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075398] Console: colour VGA+ 80x25 [ 1.096930] printk: console [ttyS1] enabled [ 1.101119] ACPI: Core revision 20230331 [ 1.105212] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.114342] APIC: Switch to symmetric I/O mode setup [ 1.119313] DMAR: Host address width 46 [ 1.123156] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128472] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136477] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142744] DMAR: ATSR flags: 0x0 [ 1.146063] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.152331] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158683] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.165037] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170437] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170437] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185458] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190766] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196989] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.207349] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327233a889f, max_idle_ns: 440795284032 ns [ 1.217863] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.39 BogoMIPS (lpj=3499698) [ 1.218881] CPU0: Thermal monitoring enabled (TM1) [ 1.219916] process: using mwait in idle threads [ 1.220863] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221862] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222863] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223863] Spectre V2 : Mitigation: Retpolines [ 1.224862] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225862] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226862] Speculative Store Bypass: Vulnerable [ 1.227867] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228862] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229862] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230865] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231862] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232862] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233862] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234862] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.247259] Freeing SMP alternatives memory: 36K [ 1.247862] pid_max: default: 32768 minimum: 301 [ 1.248880] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249866] Yama: becoming mindful. [ 1.250866] SELinux: Initializing. [ 1.251878] LSM support for eBPF active [ 1.252919] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253900] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357670] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358956] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359862] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360873] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361871] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362870] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363863] ... version: 3 [ 1.364862] ... bit width: 48 [ 1.365862] ... generic registers: 4 [ 1.366862] ... value mask: 0000ffffffffffff [ 1.367862] ... max period: 00007fffffffffff [ 1.368862] ... fixed-purpose events: 3 [ 1.369862] ... event mask: 000000070000000f [ 1.370945] signal: max sigframe size: 1776 [ 1.371873] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372887] rcu: Hierarchical SRCU implementation. [ 1.372887] rcu: Max phase no-delay instances is 400. [ 1.372895] printk: console [ttyS1] printing thread started [ 1.377461] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377527] smp: Bringing up secondary CPUs ... [ 1.377594] smpboot: x86: Booting SMP configuration: [ 1.377595] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.384130] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.384130] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.384130] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.384130] smp: Brought up 1 node, 8 CPUs [ 1.384130] smpboot: Max logical packages: 1 [ 1.384130] smpboot: Total of 8 processors activated (55995.16 BogoMIPS) [ 1.430530] node 0 deferred pages initialised in 39ms [ 1.432526] devtmpfs: initialized [ 1.432526] x86/mm: Memory block size: 128MB [ 1.434352] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 1.434352] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.434352] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.434352] pinctrl core: initialized pinctrl subsystem [ 1.451764] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.451854] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.451866] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.451874] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.451881] audit: initializing netlink subsys (disabled) [ 1.451886] audit: type=2000 audit(1713224235.254:1): state=initialized audit_enabled=0 res=1 [ 1.451930] thermal_sys: Registered thermal governor 'fair_share' [ 1.451931] thermal_sys: Registered thermal governor 'step_wise' [ 1.451931] thermal_sys: Registered thermal governor 'user_space' [ 1.461864] cpuidle: using governor menu [ 1.468890] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.468891] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.468942] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.468945] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.468953] PCI: Using configuration type 1 for base access [ 1.479889] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.479893] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.479893] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.479893] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.479893] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.486893] cryptd: max_cpu_qlen set to 1000 [ 1.494720] ACPI: Added _OSI(Module Device) [ 1.494721] ACPI: Added _OSI(Processor Device) [ 1.494722] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.494722] ACPI: Added _OSI(Processor Aggregator Device) [ 1.494723] ACPI: Added _OSI(Linux-Dell-Video) [ 1.494723] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.494724] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.518419] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.520571] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.522954] ACPI: Dynamic OEM Table Load: [ 1.535608] ACPI: _OSC evaluated successfully for all CPUs [ 1.535870] ACPI: Interpreter enabled [ 1.535879] ACPI: PM: (supports S0 S4 S5) [ 1.535880] ACPI: Using IOAPIC for interrupt routing [ 1.537382] HEST: Enabling Firmware First mode for corrected errors. [ 1.568549] HEST: Table parsing has been initialized. [ 1.568665] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.568667] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.568668] PCI: Using E820 reservations for host bridge windows [ 1.569112] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.590312] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.590316] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.591441] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.591976] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.591977] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.592004] PCI host bridge to bus 0000:ff [ 1.592005] pci_bus 0000:ff: root bus resource [bus ff] [ 1.592015] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.592058] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.592089] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.592118] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.592147] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.592177] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.592205] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.592233] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.592263] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.592290] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.592319] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.592347] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.592375] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.592404] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.592432] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.592461] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.592489] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.592517] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.592544] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.592564] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.592599] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592659] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592717] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592776] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592834] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592881] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592920] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.592951] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.592982] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593024] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593065] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593105] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593144] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.593173] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.593203] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.593236] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.593268] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593309] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593349] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593390] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593432] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.593466] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.593496] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.593526] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.593560] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.593590] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.593620] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.593650] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.593682] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.593711] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.593744] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.593774] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.593795] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.593826] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.593855] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.596094] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.596097] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.596229] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.596469] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.596470] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.596879] PCI host bridge to bus 0000:00 [ 1.596880] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.596881] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.596882] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.596883] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.596884] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.596885] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.596886] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.596905] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.597005] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.597016] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.597052] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.597142] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.597154] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.597156] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.597189] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.597276] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.597287] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.597289] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.597291] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.597295] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.597324] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.597407] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597415] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.597491] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597498] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.597572] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597579] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.597651] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597658] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.597731] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597738] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.597810] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597817] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.597892] pci 00 class 0x088000oint [ 1.597899] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.597971] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597979] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.598051] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.598112] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.598193] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.598252] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.598257] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.598335] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.598571] pci 0000: 00 class 0x0106 [ 1.598590] 0-0xf117] [ 1.598601] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.598613] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.598624] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.598635] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.598646] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.598705] pci 0000:00:11.4: PME# supported from D3hot [ 1.598784] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.598807] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.598895] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.598982] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.599005] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.599094] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.599160] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.599184] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 6000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.599352] pci 0000:00:1a.d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.599372] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.599489] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.599570] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.599606] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.599696] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.599791] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.599830] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.599836] pci 0000:00:1c.2: b [io 0xd000-0xdfff] [ 1.599839] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.599926] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.600024] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.600061] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.600066] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.600069] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.600156] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.600262] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.600282] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.600397] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.600476] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.600678] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.600696] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.600705] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.600716] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.600726] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.600737] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.600747] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.600800] pci 0000:00:1f.2: PME# supported from D3hot [ 1.600862] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.600885] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.600913] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.601076] acpiphp: Slot [1] registered [ 1.601087] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.601189] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.601198] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.601214] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.601218] pci 0000:02:00.0: enabling Extended Tags [ 1.601321] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.601427] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.601437] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.601442] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.601452] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.601456] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.601491] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.601507] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601508] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.601517] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601518] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.601666] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.601676] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.601680] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.601690] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.601695] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.601730] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.601744] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601744] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.601753] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601754] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.601891] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.601937] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.602029] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.602100] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.602113] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.602118] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.602171] pci 0000:05:00.0: enabling Extended Tags [ 1.602292] pci 0000:05:00.0: supports D1 D2 [ 1.602293] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.602428] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.602515] pci_bus 0000:06: extended config space not accessible [ 1.602548] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.602584] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.602604] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.602624] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.602722] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.602792] pci 0000:06:00.0: supports D1 D2 [ 1.602792] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.602945] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.603086] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.603119] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.603155] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.603173] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.603393] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.603453] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.603454] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.603490] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.603491] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.603824] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.603858] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.603894] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.603912] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.604125] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.604186] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.604187] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.604220] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.604221] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.604513] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.604525] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.605203] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.605234] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.605264] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.605292] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.605322] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.605322] ACPI: PCI: Interrupt link LNKE disabled [ 1.605351] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.605352] ACPI: PCI: Interrupt link LNKF disabled [ 1.605381] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.605381] ACPI: PCI: Interrupt link LNKG disabled [ 1.605410] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.605411] ACPI: PCI: Interrupt link LNKH disabled [ 1.605875] iommu: Default domain type: Translated [ 1.605875] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.605942] SCSI subsystem initialized [ 1.605955] ACPI: bus type USB registered [ 1.605968] usbcore: registered new interface driver usbfs [ 1.605974] usbcore: registered new interface driver hub [ 1.605978] usbcore: registered new device driver usb [ 1.605998] pps_core: LinuxPPS API ver. 1 registered [ 1.605998] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.606000] PTP clock support registered [ 1.606012] EDAC MC: Ver: 3.0.0 [ 1.606026] NetLabel: Initializing [ 1.606027] NetLabel: domain hash size = 128 [ 1.606027] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.606039] NetLabel: unlabeled traffic allowed by default [ 1.606040] PCI: Using ACPI for IRQ routing [ 1.616885] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.616885] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.616885] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.616885] vgaarb: loaded [ 1.616893] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.616897] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.622258] clocksource: Switched to clocksource tsc-early [ 1.622729] VFS: Disk quotas dquot_6.6.0 [ 1.622729] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.622729] pnp: PnP ACPI init [ 1.622729] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.622729] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.622729] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.622729] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.622729] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.622729] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.622729] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.622729] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.622729] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.622729] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.622729] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.622729] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.622729] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.622797] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.622799] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.622799] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.622800] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.622801] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.624044] pnp: PnP ACPI: found 5 devices [ 1.629721] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.629763] NET: Registered PF_INET protocol family [ 1.629943] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.632216] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.632247] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.632258] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.632469] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.632579] TCP: Hash tables configured (established 262144 bind 65536) [ 1.632699] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.632784] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.632839] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.632922] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.632926] NET: Registered PF_XDP protocol family [ 1.632956] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.632971] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.632974] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.632980] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.632981] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.632987] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632989] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632990] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632991] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632992] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632993] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632994] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632995] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632996] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632997] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632998] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632999] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.633000] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.633001] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.633002] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.633003] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.633004] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.633005] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.633007] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.633009] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.633012] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.633026] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.633028] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.633036] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.633052] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.633054] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.633059] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.633069] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.633075] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.633082] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.633088] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.633094] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.633096] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.633101] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.633104] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.633110] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.633111] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.633112] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.633113] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.633113] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.633114] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.633115] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.633116] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.633117] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.633118] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.633118] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.633120] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.633120] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.633121] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.633122] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.633123] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.633123] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.633124] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.633295] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.644908] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 11169 usecs [ 1.656906] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11700 usecs [ 1.656920] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.656953] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.656954] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.656960] ACPI: bus type thunderbolt registered [ 1.656973] Trying to unpack rootfs image as initramfs... [ 1.719631] Initialise system trusted keyrings [ 1.719640] Key type blacklist registered [ 1.719689] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.721023] zbud: loaded [ 1.795060] integrity: Platform Keyring initialized [ 1.795065] integrity: Machine keyring initialized [ 1.803098] NET: Registered PF_ALG protocol family [ 1.803101] xor: automatically using best checksumming function avx [ 1.803102] Key type asymmetric registered [ 1.803103] Asymmetric key parser 'x509' registered [ 1.803104] Running certificate verification selftests [ 1.804221] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.804683] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.804722] io scheduler mq-deadline registered [ 1.804724] io scheduler kyber registered [ 1.804764] io scheduler bfq registered [ 1.836400] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.836843] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.837039] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.837214] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.837370] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.837547] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.837709] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.837903] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.844561] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.853165] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.853187] ACPI: button: Power Button [PWRB] [ 1.853208] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.853240] ACPI: button: Power Button [PWRF] [ 1.861765] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.861767] pstore: Registered erst as persistent store backend [ 1.861875] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.861964] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.869385] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.878017] Non-volatile memory driver v1.3 [ 1.894323] rdac: device handler registered [ 1.894354] hp_sw: device handler registered [ 1.894355] emc: device handler registered [ 1.894382] alua: device handler registered [ 1.894742] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.894782] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.894796] ehci-pci 0000:00:1d.0: debug port 2 [ 1.898710] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.904872] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.904914] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.904916] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.904918] usb usb1: Product: EHCI Host Controller [ 1.904918] usb usb1: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.904919] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.905029] hub 1-0:1.0: USB hub found [ 1.905034] hub 1-0:1.0: 2 ports detected [ 1.905176] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.905234] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.906318] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.906523] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.906525] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.906553] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.906555] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 1.906555] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.906572] ehci-pci 0000:00:1a.0: debug port 2 [ 1.906583] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.906584] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.906585] usb usb2: Product: xHCI Host Controller [ 1.906586] usb usb2: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.906587] usb usb2: SerialNumber: 0000:00:14.0 [ 1.906678] hub 2-0:1.0: USB hub found [ 1.906708] hub 2-0:1.0: 15 ports detected [ 1.909303] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.909305] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.909305] usb usb3: Product: xHCI Host Controller [ 1.909306] usb usb3: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.909307] usb usb3: SerialNumber: 0000:00:14.0 [ 1.909371] hub 3-0:1.0: USB hub found [ 1.909387] hub 3-0:1.0: 6 ports detected [ 1.910479] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.910718] usbcore: registered new interface driver usbserial_generic [ 1.910722] usbserial: USB Serial support registered for generic [ 1.910749] i8042: PNP: No PS/2 controller found. [ 1.910775] mousedev: PS/2 mouse device common for all mice [ 1.910833] rtc_cmos 00:00: RTC can wake from S4 [ 1.911112] rtc_cmos 00:00: registered as rtc0 [ 1.911158] rtc_cmos 00:00: setting system clock to 2024-04-15T23:37:17 UTC (1713224237) [ 1.911181] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.916894] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.916921] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.916923] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.916924] usb usb4: Product: EHCI Host Controller [ 1.916925] usb usb4: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.916926] usb usb4: SerialNumber: 0000:00:1a.0 [ 1.916999] hub 4-0:1.0: USB hub found [ 1.917002] hub 4-0:1.0: 2 ports detected [ 1.919067] intel_pstate: Intel P-state driver initializing [ 1.972364] hid: raw HID events driver (C) Jiri Kosina [ 1.972419] usbcore: registered new interface driver usbhid [ 1.972420] usbhid: USB HID core driver [ 1.972478] drop_monitor: Initializing network drop monitor service [ 1.975539] Freeing initrd memory: 31028K [ 1.982365] Initializing XFRM netlink socket [ 1.982452] NET: Registered PF_INET6 protocol family [ 1.987358] Segment Routing with IPv6 [ 1.987375] NET: Registered PF_PACKET protocol family [ 1.987396] mpls_gso: MPLS GSO support [ 1.999698] microcode: Current revision: 0x0b000010 [ 2.025555] resctrl: L3 allocation detected [ 2.025556] resctrl: L3 monitoring detected [ 2.025572] IPI shorthand broadcast: enabled [ 2.025576] AVX2 version of gcm_enc/dec engaged. [ 2.053431] AES CTR mode by8 optimization enabled [ 2.053488] sched_clock: Marking stable (925119220, 1127743011)->(2393182004, -340319773) [ 2.070036] registered taskstats version 1 [ 2.086690] Loading compiled-in X.509 certificates [ 2.087191] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.087456] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.087714] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.087848] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.087857] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.088045] zswap: loaded using pool lzo/zbud [ 2.105114] page_owner is disabled [ 2.105283] pstore: Using crash dump compression: deflate [ 2.105292] Key type big_key registered [ 2.145896] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.166891] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.179898] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.241500] Key type encrypted registered [ 2.241506] ima: No TPM chip found, activating TPM-bypass! [ 2.241511] Loading compiled-in module X.509 certificates [ 2.241797] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.241799] ima: Allocated hash algorithm: sha256 [ 2.241808] ima: No architecture policies found [ 2.241815] evm: Initialising EVM extended attributes: [ 2.241815] evm: security.selinux [ 2.241816] evm: security.SMACK64 (disabled) [ 2.241816] evm: security.SMACK64EXEC (disabled) [ 2.241817] evm: security.SMACK64TRANSMUTE (disabled) [ 2.241817] evm: security.SMACK64MMAP (disabled) [ 2.241818] evm: security.apparmor (disabled) [ 2.241818] evm: security.ima [ 2.241819] evm: security.capability [ 2.241819] evm: HMAC attrs: 0x1 [ 2.284065] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.284067] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.285094] hub 1-1:1.0: USB hub found [ 2.285512] hub 1-1:1.0: 8 ports detected [ 2.297044] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.297047] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.297553] hub 2-12:1.0: USB hub found [ 2.297630] hub 2-12:1.0: 4 ports detected [ 2.317287] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.317289] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.317439] hub 4-1:1.0: USB hub found [ 2.317536] hub 4-1:1.0: 6 ports detected [ 2.608868] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.700874] tsc: Refined TSC clocksource calibration: 3499.992 MHz [ 2.700877] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns [ 2.703072] clocksource: Switched to clocksource tsc [ 2.712225] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.712227] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.717251] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.768996] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.771646] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.771729] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.230030] Freeing unused decrypted memory: 2028K [ 5.230466] Freeing unused kernel image (initmem) memory: 3932K [ 5.230504] Write protecting the kernel read-only data: 28672k [ 5.230674] Freeing unused kernel image (rodata/data gap) memory: 492K [ 5.271521] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.271522] x86/mm: Checking user space page tables [ 5.310244] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.310254] Run /init as init process [ 5.323809] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.323931] systemd[1]: Detected architecture x86-64. [ 5.323932] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-44.git20230822.el9 (Initramfs)! [ 5.374976] systemd[1]: Hostname set to . [ OK [[ 5.432214] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.432323] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.454023] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.468070] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.480002] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.490994] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.503008] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.518002] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.532030] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.544154] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.558154] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.571932] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.590597] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.606112] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.618587] systemd[1]: Starting Load Kernel Modules... g Load Kernel Modules... [ 5.634225] fuse: init (API version 7.36) Startin[ 5.640003] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.652676] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.665610] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.045414] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.103420] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.103423] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.103455] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.103457] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.128455] nvme nvme0: pci function 0000:02:00.0 [ 6.135927] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.135930] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.136401] nvme nvme0: 8/0/0 default/read/poll queues [ 6.146226] scsi host0: ahci [ 6.146550] scsi host1: ahci [ 6.146852] scsi host2: ahci [ 6.147199] scsi host3: ahci [ 6.147242] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 44 lpm-pol 0 [ 6.147244] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 44 lpm-pol 0 [ 6.147248] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 44 lpm-pol 0 [ 6.147250] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 44 lpm-pol 0 [ 6.147609] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.147613] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.160945] ACPI: bus type drm_connector registered [ 6.162251] scsi host4: ahci [ 6.162378] scsi host5: ahci [ 6.162553] scsi host6: ahci [ 6.162781] scsi host7: ahci [ 6.163213] scsi host8: ahci [ 6.163446] scsi host9: ahci [ 6.163510] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 lpm-pol 0 [ 6.163512] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 lpm-pol 0 [ 6.163514] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 lpm-pol 0 [ 6.163517] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 lpm-pol 0 [ 6.163521] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 lpm-pol 0 [ 6.163525] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 lpm-pol 0 [ 6.182499] igb 0000:07:00.0: added PHC on eth0 [ 6.182529] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.182531] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:44 [ 6.182606] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.182607] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.229390] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.236386] igb 0000:07:00.1: added PHC on eth1 [ 6.236416] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.236417] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:45 [ 6.236503] igb 0000:07:00.1: et6503] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.237562] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.246160] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.249807] Console: switching to colour dummy device 80x25 [ 6.249967] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.249968] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.249984] ast 0000:06:00.0: [drm] Using analog VGA [ 6.249993] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.250142] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.257436] fbcon: astdrmfb (fb0) is primary device [ 6.282019] Console: switching to colour frame buffer device 128x48 [ 6.300909] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.458251] ata4: SATA link down (SStatus 0 SControl 300) [ 6.458280] ata3: SATA link down (SStatus 0 SControl 300) [ 6.458590] ata1: SATA link down (SStatus 0 SControl 300) [ 6.458650] ata2: SATA link down (SStatus 0 SControl 300) [ 6.475772] ata7: SATA link down (SStatus 0 SControl 300) [ 6.476038] ata8: SATA link down (SStatus 0 SControl 300) [ 6.476058] ata9: SATA link down (SStatus 0 SControl 300) [ 6.476141] ata6: SATA link down (SStatus 0 SControl 300) [ta10: SATA link rol 300) [ 6TA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.477191] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.477679] ata5.00: NCQ Send/Recv Log not supported [ 6.477680] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.479133] ata5.00: NCQ Send/Recv Log not supported [ 6.479136] ata5.00: configured for UDMA/133 [ 6.479229] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.543792] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.622711] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.622726] sd 4:0:0:0: [sda] Write Protect is off [ 6.622746] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.622770] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.630212] sda: sda1 [ 6.630301] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.242180] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.242468] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.242550] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.242551] ixgbe 0000:03:00.0: 0c:c4:7a:8f:ce:8e [ 7.245729] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.402148] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.402434] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.402516] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.402517] ixgbe 0000:03:00.1: 0c:c4:7a:8f:ce:8f [ 7.405684] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.413692] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.447440] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…7844-4e73-a652-6bb884dfb0a5... [ OK ] Finished File System Check…0-7844-4e73-a652-6bb884dfb0a5. Mounting /sysroot... [ OK [[ 7.695962] EXT4-fs (sda1): mounted filesystem 0b261d40-7844-4e73-a652-6bb884dfb0a5 ro with ordered data mode. Quota mode: none. 0m] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Swi[ 8.034068] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). tch Root... [ 8.553700] SELinux: policy capability network_peer_controls=1 [ 8.553703] SELinux: policy capability open_perms=1 [ 8.553704] SELinux: policy capability extended_socket_class=1 [ 8.553704] SELinux: policy capability always_check_network=0 [ 8.553705] SELinux: policy capability cgroup_seclabel=1 [ 8.553705] SELinux: policy capability nnp_nosuid_transition=1 [ 8.553705] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.597279] audit: type=1403 audit(1713224244.184:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.608611] systemd[1]: Successfully loaded SELinux policy in 119.392ms. [ 8.704391] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 31.075ms. [ 8.733673] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.733782] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ OK [[ 9.798009] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.798120] systemd[1]: Stopped Switch Root. 0m] Stopped [0;[ 9.798539] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.798847] systemd[1]: Created slice Slice /system/getty. 1;39mSwitch Root[ 9.799163] systemd[1]: Created slice Slice /system/modprobe. [ 9.811460] systemd[1]: Created slice Slice /system/serial-getty. . [[ 9.840368] systemd[1]: Created slice Slice /system/sshd-keygen. OK ] Crea[ 9.840633] systemd[1]: Created slice User and Session Slice. [ 9.840662] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). ted slice [0;1;[ 9.840757] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.841121] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. 39mSlice /system[ 9.847569] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. /getty. [[ 9.899648] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.899675] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [0;32m OK [ 9.899689] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. ] Created slice [ 9.899703] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.899729] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. Slice /[ 9.899748] systemd[1]: Reached target Local Encrypted Volumes. [ 9.899773] systemd[1]: Stopped target Switch Root. system/modprobe[ 9.899791] systemd[1]: Stopped target Initrd File Systems. [ 9.899805] systemd[1]: Stopped target Initrd Root File System. [0m. [ [ 9.899821] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.899853] systemd[1]: Reached target Path Units. OK ] Creat[ 9.899887] systemd[1]: Reached target Slice Units. [ 9.933426] systemd[1]: Reached target Swaps. ed slice [0;1;3[ 9.933451] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.956823] systemd[1]: Listening on Device-mapper event daemon FIFOs. 9mSlice /system/[ 9.964378] systemd[1]: Listening on LVM2 poll daemon socket. serial-getty. [ OK ] Created slice S[ 10.030331] systemd[1]: Listening on RPCbind Server Activation Socket. lice /system/ssh[ 10.030387] systemd[1]: Reached target RPC Port Mapper. [ 10.037849] systemd[1]: Listening on Process Core Dump Socket. d-keygen. [ 10.038718] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 10.052024] systemd[1]: Listening on udev Control Socket. [ OK [[ 10.064586] systemd[1]: Listening on udev Kernel Socket. 0m] Created slic[ 10.065456] systemd[1]: Mounting Huge Pages File System... [ 10.071874] systemd[1]: Mounting POSIX Message Queue File System... e User and Session Slic[ 10.085370] systemd[1]: Mounting Kernel Debug File System... [ 10.086237] systemd[1]: Mounting Kernel Trace File System... e. [[0;32[ 10.098314] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). m OK ] Sta[ 10.111523] systemd[1]: Starting Create List of Static Device Nodes... [ 10.113584] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... rted Fo[ 10.131746] systemd[1]: Starting Load Kernel Module configfs... [ 10.132524] systemd[1]: Starting Load Kernel Module drm... rward Password R[ 10.139042] systemd[1]: Starting Load Kernel Module fuse... …uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ [ 10.162396] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... OK ] Reach[ 10.162462] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.162504] systemd[1]: Stopped Plymouth switch root service. ed target [0;1;[ 10.162682] systemd[1]: Stopped Journal Service. 39mceph target\xe2\x80[ 10.192436] systemd[1]: Starting Journal Service... \xa6on@.service ins[ 10.194877] systemd[1]: Starting Load Kernel Modules... [ 10.198969] systemd[1]: Starting Generate network units from Kernel command line... tances at once. [ [ 10.213399] systemd[1]: Starting Remount Root and Kernel File Systems... OK ] Reache[ 10.213502] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.214486] systemd[1]: Starting Coldplug All udev Devices... d target [0;1;3[ 10.223347] systemd[1]: Mounted Huge Pages File System. [ 10.243474] EXT4-fs (sda1): re-mounted 0b261d40-7844-4e73-a652-6bb884dfb0a5 r/w. Quota mode: none. 9mceph target…[ 10.245685] systemd[1]: Mounted POSIX Message Queue File System. ds@.service inst[ 10.254201] systemd[1]: Mounted Kernel Debug File System. ances at once[0[ 10.268444] systemd[1]: Started Journal Service. m. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached targ[ 10.346539] systemd-journald[578]: Received client request to flush runtime journal. et Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System[[ 10.441710] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. 0m... [ 10.441728] device-mapper: uevent: version 1.0.3 [ 10.441831] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. [ OK ] Mounted FUSE Control File System. Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader Update. [ 10.881476] IPMI message handler: version 39.2 [ 10.886395] ipmi device interface [ 10.899294] ipmi_si: IPMI System Interface driver [ 10.899305] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.899307] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.899309] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.899348] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.899417] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.899706] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.899707] ipmi_si: Adding ACPI-specified kcs state machine [ 10.899750] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.962985] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.969900] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.972898] igb 0000:07:00.0: DCA enabled [ 10.972915] igb 0000:07:00.1: DCA enabled [ 10.973190] power_meter ACPI000D:00: Found ACPI power meter. [ 10.973211] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.973216] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.976878] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.018575] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 11.033409] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.034407] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 11.034410] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 11.069577] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.069580] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.069581] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.091147] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.106361] iTCO_vendor_support: vendor-support=0 [ 11.115550] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.115845] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 11.182392] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Finished Create Volatile Files and Directories. [ 11.292068] ipmi_ssif: IPMI SSIF Interface driver Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.484516] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.484517] EDAC sbridge: Ver: 1.1.2 [ 11.491097] RPC: Registered named UNIX socket transport module. [ 11.491099] RPC: Registered udp transport module. [ 11.491100] RPC: Registered tcp transport module. [ 11.491101] RPC: Registered tcp-with-tls transport module. [ 11.491101] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.742589] intel_rapl_common: Found RAPL domain package [ 11.742594] intel_rapl_common: Found RAPL domain dram [ 11.742825] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.753933] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 11.754045] XFS (dm-4): Mounting V4 Filesystem d6c01728-66b3-4325-83c2-85b28a05635d [ 11.758344] XFS (dm-4): Ending clean mount [ 11.758384] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Authorization Manager... Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started Authorization Manager. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.810836] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.967560] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... [ 16.192913] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ 16.276936] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.277040] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network Manager Wait Online (9s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (11s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.115 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... + '[' 172.21.15.115 '!=' '' ']' + set -e + '[' -n 172.21.15.115 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.115 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.115 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi115.front.sepia.ceph.com + '[' -n smithi115.front.sepia.ceph.com ']' + hostname smithi115.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi115 + echo smithi115 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.115 smithi115.front.sepia.ceph.com smithi115/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ 26.316466] block sda: the capability attribute has been deprecated. CentOS Stream 9 Kernel 5.14.0-438.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2024-04-15T23:37:45.238 DEBUG:teuthology.orchestra.console.smithi115:expect after: smithi115 login: 2024-04-15T23:37:45.292 DEBUG:teuthology.orchestra.console.smithi115:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing tel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot Age t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F CE 8F GUID: 00000000 0000 0000 0000 0CC47AD8A544 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.115 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.115 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:ce:8f)... Configuring (net0 0c:c4:7a:8f:ce:8f).... Configuring (net0 0c:c4:7a:8f:ce:8f)..... Configuring (net0 0c:c4:7a:8f:ce:8f)...... ok [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   CentOS Stream (5.14.0-438.el9.x86_64) 9  CentOS Stream (5.14.0-361.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9              The selected entry will be started automatically in 5s.   CentOS Stream (5.14.0-438.el9.x86_64) 9   CentOS Stream (5.14.0-361.el9.x86_64) 9  CentOS Stream (5.14.0-239.el9.x86_64) 9  CentOS Stream (0-rescue-15949e3c88704300882482eddfd7baae) 9            Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h       [ 0.000000] Linux version 5.14.0-438.el9.x86_64 (mockbuild@x86-05.stream.rdu2.redhat.com) (gcc (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3), GNU ld version 2.35.2-43.el9) #1 SMP PREEMPT_DYNAMIC Fri Apr 12 13:55:21 UTC 2024 [ 0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com. [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,1152000] BIOS-provided[ 0.000000] B0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078eacfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f5f000-0x00000000798acfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ad000-0x0000000079d49fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4a000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] APIC: Static calls initialized [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.698 MHz processor [ 0.000434] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000438] MTRR map: 5 entries (3 fixed + 2 variable; max 23), built from 10 variable MTRRs [ 0.000439] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000770] last_pfn = 0x78ead max_arch_pfn = 0x400000000 [ 0.006541] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.006549] Using GB pages for direct mapping [ 0.006621] RAMDISK: [mem 0x34356000-0x361a2fff] [ 0.006623] ACPI: Early table checksum verification disabled [ 0.006625] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.006628] ACPI: XSDT 0x00000000798AD098 0000B4 (v01 01072009 AMI 00010013) [ 0.006633] ACPI: FACP 0x00000000798E05B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006637] ACPI: DSDT 0x00000000798AD1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.006640] ACPI: FACS 0x0000000079D48F80 000040 [ 0.006642] ACPI: APIC 0x00000000798E06C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006644] ACPI: FPDT 0x00000000798E0788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006646] ACPI: FIDT 0x00000000798E07D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.006649] ACPI: SPMI 0x00000000798E0870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.006651] ACPI: MCFG 0x00000000798E08B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.006653] ACPI: UEFI 0x00000000798E08F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.006656] ACPI: HPET 0x00000000798E0938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006658] ACPI: WDDT 0x00000000798E0970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.006660] ACPI: SSDT 0x00000000798E09B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.006662] ACPI: SSDT 0x00000000798F7B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.006665] ACPI: SSDT 0x00000000798FA180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.006667] ACPI: PRAD 0x00000000798FA1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.006669] ACPI: DMAR 0x00000000798FA2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.006672] ACPI: HEST 0x00000000798FA3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006674] ACPI: BERT 0x00000000798FA630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006676] ACPI: ERST 0x00000000798FA660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006678] ACPI: EINJ 0x00000000798FA890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.006680] ACPI: Reserving FACP table memory at [mem 0x798e05b0-0x798e06bb] [ 0.006681] ACPI: Reserving DSDT table memory at [mem 0x798ad1e8-0x798e05ab] [ 0.006682] ACPI: Reserving FACS table memory at [mem 0x79d48f80-0x79d48fbf] [ 0.006682] ACPI: Reserving APIC table memory at [mem 0x798e06c0-0x798e0787] [ 0.006683] ACPI: Reserving FPDT table memory at [mem 0x798e0788-0x798e07cb] [ 0.006684] ACPI: Reserving FIDT table memory at [mem 0x798e07d0-0x798e086b] [ 0.006684] ACPI: Reserving SPMI table memory at [mem 0x798e0870-0x798e08af] [ 0.006685] ACPI: Reserving MCFG table memory at [mem 0x798e08b0-0x798e08eb] [ 0.006685] ACPI: Reserving UEFI table memory at [mem 0x798e08f0-0x798e0931] [ 0.006686] ACPI: Reserving HPET table memory at [mem 0x798e0938-0x798e096f] [ 0.006687] ACPI: Reserving WDDT table memory at [mem 0x798e0970-0x798e09af] [ 0.006687] ACPI: Reserving SSDT table memory at [mem 0x798e09b0-0x798f7b2e] [ 0.006688] ACPI: Reserving SSDT table memory at [mem 0x798f7b30-0x798fa17b] [ 0.006688] ACPI: Reserving SSDT table memory at [mem 0x798fa180-0x798fa1e3] [ 0.006689] ACPI: Reserving PRAD table memory at [mem 0x798fa1e8-0x798fa2e9] [ 0.006689] ACPI: Reserving DMAR table memory at [mem 0x798fa2f0-0x798fa3ab] [ 0.006690] ACPI: Reserving HEST table memory at [mem 0x798fa3b0-0x798fa62b] [ 0.006691] ACPI: Reserving BERT table memory at [mem 0x798fa630-0x798fa65f] [ 0.006691] ACPI: Reserving ERST table memory at [mem 0x798fa660-0x798fa88f] [ 0.006692] ACPI: Reserving EINJ table memory at [mem 0x798fa890-0x798fa9bf] [ 0.006737] No NUMA configuration found [ 0.006737] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.006746] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.006940] Reserving 256MB of memory at 1664MB for crashkernel (System RAM: 32654MB) [ 0.006975] Zone ranges: [ 0.006976] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.006977] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.006978] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.006979] Device empty [ 0.006980] Movable zone start for each node [ 0.006982] Early memory node ranges [ 0.006983] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.006984] node 0: [mem 0x0000000000100000-0x0000000078eacfff] [ 0.006985] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.006988] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.006993] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.007028] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.011834] On node 0, zone Normal: 29011 pages in unavailable ranges [ 0.011943] ACPI: PM-Timer IO Port: 0x408 [ 0.011952] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.011953] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.011954] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.011954] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.011955] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.011955] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.011956] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.011957] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.011965] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.011970] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.011971] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.011973] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.011976] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.011977] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.011982] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.011983] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.011992] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.011993] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.011994] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.011995] PM: hibernation: Registered nosave memory: [mem 0x78ead000-0x78f5efff] [ 0.011996] PM: hibernation: Registered nosave memory: [mem 0x78f5f000-0x798acfff] [ 0.011996] PM: hibernation: Registered nosave memory: [mem 0x798ad000-0x79d49fff] [ 0.011997] PM: hibernation: Registered nosave memory: [mem 0x79d4a000-0x8fffffff] [ 0.011997] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.011998] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.011998] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.011999] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.012000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.012001] Booting paravirtualized kernel on bare hardware [ 0.012003] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.016314] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.016531] percpu: Embedded 63 pages/cpu s221184 r8192 d28672 u262144 [ 0.016556] Fallback order for Node 0: 0 [ 0.016558] Built 1 zonelists, mobility grouping on. Total pages: 8228722 [ 0.016559] Policy zone: Normal [ 0.016560] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64 root=UUID=0b261d40-7844-4e73-a652-6bb884dfb0a5 ro crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M console=ttyS1,115200 [ 0.016616] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-5.14.0-438.el9.x86_64", will be passed to user space. [ 0.016632] random: crng init done [ 0.018798] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.019929] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.020175] mem auto-init: stack:off, heap alloc:off, heap free:off [ 0.020182] software IO TLB: area num 8. [ 0.047812] Memory: 1752188K/33437916K available (16384K kernel code, 5629K rwdata, 11796K rodata, 3932K init, 5900K bss, 987080K reserved, 0K cma-reserved) [ 0.047914] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.047922] Kernel/User page tables isolation: enabled [ 0.047944] ftrace: allocating 47003 entries in 184 pages [ 0.066144] ftrace: allocated 184 pages with 4 groups [ 0.066649] Dynamic Preempt: voluntary [ 0.066677] rcu: Preemptible hierarchical RCU implementation. [ 0.066678] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.066679] Trampoline variant of Tasks RCU enabled. [ 0.066679] Rude variant of Tasks RCU enabled. [ 0.066680] Tracing variant of Tasks RCU enabled. [ 0.066680] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.066681] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.069929] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.070090] rcu: srcu_init: Setting srcu_struct sizes based on contention. [ 0.070197] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.075398] Console: colour VGA+ 80x25 [ 1.096930] printk: console [ttyS1] enabled [ 1.101119] ACPI: Core revision 20230331 [ 1.105212] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.114342] APIC: Switch to symmetric I/O mode setup [ 1.119313] DMAR: Host address width 46 [ 1.123156] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.128472] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.136477] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.142744] DMAR: ATSR flags: 0x0 [ 1.146063] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.152331] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.158683] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.165037] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.170437] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.170437] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.185458] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.190766] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.196989] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.207349] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x327233a889f, max_idle_ns: 440795284032 ns [ 1.217863] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.39 BogoMIPS (lpj=3499698) [ 1.218881] CPU0: Thermal monitoring enabled (TM1) [ 1.219916] process: using mwait in idle threads [ 1.220863] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.221862] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.222863] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.223863] Spectre V2 : Mitigation: Retpolines [ 1.224862] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.225862] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.226862] Speculative Store Bypass: Vulnerable [ 1.227867] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.228862] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.229862] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode [ 1.230865] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.231862] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.232862] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.233862] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.234862] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.247259] Freeing SMP alternatives memory: 36K [ 1.247862] pid_max: default: 32768 minimum: 301 [ 1.248880] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf [ 1.249866] Yama: becoming mindful. [ 1.250866] SELinux: Initializing. [ 1.251878] LSM support for eBPF active [ 1.252919] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.253900] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.357670] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.358956] cblist_init_generic: Setting adjustable number of callback queues. [ 1.359862] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.360873] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.361871] cblist_init_generic: Setting shift to 3 and lim to 1. [ 1.362870] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.363863] ... version: 3 [ 1.364862] ... bit width: 48 [ 1.365862] ... generic registers: 4 [ 1.366862] ... value mask: 0000ffffffffffff [ 1.367862] ... max period: 00007fffffffffff [ 1.368862] ... fixed-purpose events: 3 [ 1.369862] ... event mask: 000000070000000f [ 1.370945] signal: max sigframe size: 1776 [ 1.371873] Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.372887] rcu: Hierarchical SRCU implementation. [ 1.372887] rcu: Max phase no-delay instances is 400. [ 1.372895] printk: console [ttyS1] printing thread started [ 1.377461] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.377527] smp: Bringing up secondary CPUs ... [ 1.377594] smpboot: x86: Booting SMP configuration: [ 1.377595] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 [ 1.384130] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.384130] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.384130] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.384130] smp: Brought up 1 node, 8 CPUs [ 1.384130] smpboot: Max logical packages: 1 [ 1.384130] smpboot: Total of 8 processors activated (55995.16 BogoMIPS) [ 1.430530] node 0 deferred pages initialised in 39ms [ 1.432526] devtmpfs: initialized [ 1.432526] x86/mm: Memory block size: 128MB [ 1.434352] ACPI: PM: Registering ACPI NVS region [mem 0x798ad000-0x79d49fff] (4837376 bytes) [ 1.434352] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 1.434352] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.434352] pinctrl core: initialized pinctrl subsystem [ 1.451764] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.451854] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.451866] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.451874] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.451881] audit: initializing netlink subsys (disabled) [ 1.451886] audit: type=2000 audit(1713224235.254:1): state=initialized audit_enabled=0 res=1 [ 1.451930] thermal_sys: Registered thermal governor 'fair_share' [ 1.451931] thermal_sys: Registered thermal governor 'step_wise' [ 1.451931] thermal_sys: Registered thermal governor 'user_space' [ 1.461864] cpuidle: using governor menu [ 1.468890] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.468891] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.468942] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff] [ 1.468945] PCI: ECAM [mem 0x80000000-0x8fffffff] reserved as E820 entry [ 1.468953] PCI: Using configuration type 1 for base access [ 1.479889] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.479893] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages [ 1.479893] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page [ 1.479893] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages [ 1.479893] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page [ 1.486893] cryptd: max_cpu_qlen set to 1000 [ 1.494720] ACPI: Added _OSI(Module Device) [ 1.494721] ACPI: Added _OSI(Processor Device) [ 1.494722] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.494722] ACPI: Added _OSI(Processor Aggregator Device) [ 1.494723] ACPI: Added _OSI(Linux-Dell-Video) [ 1.494723] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.494724] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.518419] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.520571] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.522954] ACPI: Dynamic OEM Table Load: [ 1.535608] ACPI: _OSC evaluated successfully for all CPUs [ 1.535870] ACPI: Interpreter enabled [ 1.535879] ACPI: PM: (supports S0 S4 S5) [ 1.535880] ACPI: Using IOAPIC for interrupt routing [ 1.537382] HEST: Enabling Firmware First mode for corrected errors. [ 1.568549] HEST: Table parsing has been initialized. [ 1.568665] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.568667] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.568668] PCI: Using E820 reservations for host bridge windows [ 1.569112] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.590312] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.590316] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.591441] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.591976] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.591977] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.592004] PCI host bridge to bus 0000:ff [ 1.592005] pci_bus 0000:ff: root bus resource [bus ff] [ 1.592015] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 conventional PCI endpoint [ 1.592058] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 conventional PCI endpoint [ 1.592089] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 conventional PCI endpoint [ 1.592118] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 conventional PCI endpoint [ 1.592147] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 conventional PCI endpoint [ 1.592177] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 conventional PCI endpoint [ 1.592205] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 conventional PCI endpoint [ 1.592233] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 conventional PCI endpoint [ 1.592263] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 conventional PCI endpoint [ 1.592290] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 conventional PCI endpoint [ 1.592319] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 conventional PCI endpoint [ 1.592347] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 conventional PCI endpoint [ 1.592375] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 conventional PCI endpoint [ 1.592404] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 conventional PCI endpoint [ 1.592432] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 conventional PCI endpoint [ 1.592461] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 conventional PCI endpoint [ 1.592489] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 conventional PCI endpoint [ 1.592517] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 conventional PCI endpoint [ 1.592544] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 conventional PCI endpoint [ 1.592564] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 conventional PCI endpoint [ 1.592599] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592659] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592717] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592776] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592834] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592881] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.592920] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 conventional PCI endpoint [ 1.592951] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 conventional PCI endpoint [ 1.592982] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593024] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593065] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593105] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593144] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 conventional PCI endpoint [ 1.593173] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 conventional PCI endpoint [ 1.593203] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 conventional PCI endpoint [ 1.593236] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 conventional PCI endpoint [ 1.593268] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593309] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593349] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593390] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.593432] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 conventional PCI endpoint [ 1.593466] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 conventional PCI endpoint [ 1.593496] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 conventional PCI endpoint [ 1.593526] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 conventional PCI endpoint [ 1.593560] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 conventional PCI endpoint [ 1.593590] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 conventional PCI endpoint [ 1.593620] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 conventional PCI endpoint [ 1.593650] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 conventional PCI endpoint [ 1.593682] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 conventional PCI endpoint [ 1.593711] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 conventional PCI endpoint [ 1.593744] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 conventional PCI endpoint [ 1.593774] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 conventional PCI endpoint [ 1.593795] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 conventional PCI endpoint [ 1.593826] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 conventional PCI endpoint [ 1.593855] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 conventional PCI endpoint [ 1.596094] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 1.596097] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.596229] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.596469] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.596470] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.596879] PCI host bridge to bus 0000:00 [ 1.596880] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 1.596881] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 1.596882] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.596883] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 1.596884] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 1.596885] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 1.596886] pci_bus 0000:00: root bus resource [bus 00-fe] [ 1.596905] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 PCIe Root Port [ 1.597005] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 PCIe Root Port [ 1.597016] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.597052] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.597142] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 PCIe Root Port [ 1.597154] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.597156] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.597189] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.597276] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 PCIe Root Port [ 1.597287] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.597289] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.597291] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.597295] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.597324] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.597407] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597415] pci 0000:00:04.0: BAR 0 [mem 0xfb42c000-0xfb42ffff 64bit] [ 1.597491] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597498] pci 0000:00:04.1: BAR 0 [mem 0xfb428000-0xfb42bfff 64bit] [ 1.597572] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597579] pci 0000:00:04.2: BAR 0 [mem 0xfb424000-0xfb427fff 64bit] [ 1.597651] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597658] pci 0000:00:04.3: BAR 0 [mem 0xfb420000-0xfb423fff 64bit] [ 1.597731] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597738] pci 0000:00:04.4: BAR 0 [mem 0xfb41c000-0xfb41ffff 64bit] [ 1.597810] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597817] pci 0000:00:04.5: BAR 0 [mem 0xfb418000-0xfb41bfff 64bit] [ 1.597892] pci 00 class 0x088000oint [ 1.597899] pci 0000:00:04.6: BAR 0 [mem 0xfb414000-0xfb417fff 64bit] [ 1.597971] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.597979] pci 0000:00:04.7: BAR 0 [mem 0xfb410000-0xfb413fff 64bit] [ 1.598051] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.598112] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.598193] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 PCIe Root Complex Integrated Endpoint [ 1.598252] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 PCIe Root Complex Integrated Endpoint [ 1.598257] pci 0000:00:05.4: BAR 0 [mem 0xfb439000-0xfb439fff] [ 1.598335] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 PCIe Root Complex Integrated Endpoint [ 1.598571] pci 0000: 00 class 0x0106 [ 1.598590] 0-0xf117] [ 1.598601] pci 0000:00:11.4: BAR 1 [io 0xf100-0xf103] [ 1.598613] pci 0000:00:11.4: BAR 2 [io 0xf0f0-0xf0f7] [ 1.598624] pci 0000:00:11.4: BAR 3 [io 0xf0e0-0xf0e3] [ 1.598635] pci 0000:00:11.4: BAR 4 [io 0xf020-0xf03f] [ 1.598646] pci 0000:00:11.4: BAR 5 [mem 0xfb438000-0xfb4387ff] [ 1.598705] pci 0000:00:11.4: PME# supported from D3hot [ 1.598784] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 conventional PCI endpoint [ 1.598807] pci 0000:00:14.0: BAR 0 [mem 0xfb400000-0xfb40ffff 64bit] [ 1.598895] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 1.598982] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 conventional PCI endpoint [ 1.599005] pci 0000:00:16.0: BAR 0 [mem 0xfb437000-0xfb43700f 64bit] [ 1.599094] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.599160] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 conventional PCI endpoint [ 1.599184] pci 0000:00:16.1: BAR 0 [mem 0xfb436000-0xfb43600f 6000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.599352] pci 0000:00:1a.d2d] type 00 class 0x0c0320 conventional PCI endpoint [ 1.599372] pci 0000:00:1a.0: BAR 0 [mem 0xfb434000-0xfb4343ff] [ 1.599489] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.599570] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 PCIe Root Port [ 1.599606] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.599696] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.599791] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 PCIe Root Port [ 1.599830] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.599836] pci 0000:00:1c.2: b [io 0xd000-0xdfff] [ 1.599839] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.599926] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 1.600024] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 PCIe Root Port [ 1.600061] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.600066] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.600069] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.600156] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 1.600262] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 conventional PCI endpoint [ 1.600282] pci 0000:00:1d.0: BAR 0 [mem 0xfb433000-0xfb4333ff] [ 1.600397] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.600476] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 conventional PCI endpoint [ 1.600678] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 conventional PCI endpoint [ 1.600696] pci 0000:00:1f.2: BAR 0 [io 0xf070-0xf077] [ 1.600705] pci 0000:00:1f.2: BAR 1 [io 0xf060-0xf063] [ 1.600716] pci 0000:00:1f.2: BAR 2 [io 0xf050-0xf057] [ 1.600726] pci 0000:00:1f.2: BAR 3 [io 0xf040-0xf043] [ 1.600737] pci 0000:00:1f.2: BAR 4 [io 0xf000-0xf01f] [ 1.600747] pci 0000:00:1f.2: BAR 5 [mem 0xfb432000-0xfb4327ff] [ 1.600800] pci 0000:00:1f.2: PME# supported from D3hot [ 1.600862] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 conventional PCI endpoint [ 1.600885] pci 0000:00:1f.3: BAR 0 [mem 0xfb431000-0xfb4310ff 64bit] [ 1.600913] pci 0000:00:1f.3: BAR 4 [io 0x0580-0x059f] [ 1.601076] acpiphp: Slot [1] registered [ 1.601087] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.601189] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 PCIe Endpoint [ 1.601198] pci 0000:02:00.0: BAR 0 [mem 0xfb310000-0xfb313fff 64bit] [ 1.601214] pci 0000:02:00.0: ROM [mem 0xfb300000-0xfb30ffff pref] [ 1.601218] pci 0000:02:00.0: enabling Extended Tags [ 1.601321] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.601427] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.601437] pci 0000:03:00.0: BAR 0 [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 1.601442] pci 0000:03:00.0: BAR 2 [io 0xe020-0xe03f] [ 1.601452] pci 0000:03:00.0: BAR 4 [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 1.601456] pci 0000:03:00.0: ROM [mem 0xfb280000-0xfb2fffff pref] [ 1.601491] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 1.601507] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601508] pci 0000:03:00.0: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.601517] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601518] pci 0000:03:00.0: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.601666] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 PCIe Endpoint [ 1.601676] pci 0000:03:00.1: BAR 0 [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 1.601680] pci 0000:03:00.1: BAR 2 [io 0xe000-0xe01f] [ 1.601690] pci 0000:03:00.1: BAR 4 [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 1.601695] pci 0000:03:00.1: ROM [mem 0xfb200000-0xfb27ffff pref] [ 1.601730] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 1.601744] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601744] pci 0000:03:00.1: VF BAR 0 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 0 for 64 VFs [ 1.601753] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.601754] pci 0000:03:00.1: VF BAR 3 [mem 0x00000000-0x000fffff 64bit pref]: contains BAR 3 for 64 VFs [ 1.601891] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.601937] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.602029] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge [ 1.602100] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.602113] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.602118] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.602171] pci 0000:05:00.0: enabling Extended Tags [ 1.602292] pci 0000:05:00.0: supports D1 D2 [ 1.602293] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.602428] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.602515] pci_bus 0000:06: extended config space not accessible [ 1.602548] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint [ 1.602584] pci 0000:06:00.0: BAR 0 [mem 0xfa000000-0xfaffffff] [ 1.602604] pci 0000:06:00.0: BAR 1 [mem 0xfb000000-0xfb01ffff] [ 1.602624] pci 0000:06:00.0: BAR 2 [io 0xd000-0xd07f] [ 1.602722] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.602792] pci 0000:06:00.0: supports D1 D2 [ 1.602792] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 1.602945] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.603086] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.603119] pci 0000:07:00.0: BAR 0 [mem 0xfb120000-0xfb13ffff] [ 1.603155] pci 0000:07:00.0: BAR 2 [io 0xc020-0xc03f] [ 1.603173] pci 0000:07:00.0: BAR 3 [mem 0xfb144000-0xfb147fff] [ 1.603393] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 1.603453] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.603454] pci 0000:07:00.0: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.603490] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.603491] pci 0000:07:00.0: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.603824] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 PCIe Endpoint [ 1.603858] pci 0000:07:00.1: BAR 0 [mem 0xfb100000-0xfb11ffff] [ 1.603894] pci 0000:07:00.1: BAR 2 [io 0xc000-0xc01f] [ 1.603912] pci 0000:07:00.1: BAR 3 [mem 0xfb140000-0xfb143fff] [ 1.604125] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 1.604186] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x00003fff 64bit pref] [ 1.604187] pci 0000:07:00.1: VF BAR 0 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 0 for 8 VFs [ 1.604220] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x00003fff 64bit pref] [ 1.604221] pci 0000:07:00.1: VF BAR 3 [mem 0x00000000-0x0001ffff 64bit pref]: contains BAR 3 for 8 VFs [ 1.604513] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.604525] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 1.605203] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 1.605234] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 1.605264] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 1.605292] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 1.605322] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 1.605322] ACPI: PCI: Interrupt link LNKE disabled [ 1.605351] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 1.605352] ACPI: PCI: Interrupt link LNKF disabled [ 1.605381] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 1.605381] ACPI: PCI: Interrupt link LNKG disabled [ 1.605410] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 1.605411] ACPI: PCI: Interrupt link LNKH disabled [ 1.605875] iommu: Default domain type: Translated [ 1.605875] iommu: DMA domain TLB invalidation policy: lazy mode [ 1.605942] SCSI subsystem initialized [ 1.605955] ACPI: bus type USB registered [ 1.605968] usbcore: registered new interface driver usbfs [ 1.605974] usbcore: registered new interface driver hub [ 1.605978] usbcore: registered new device driver usb [ 1.605998] pps_core: LinuxPPS API ver. 1 registered [ 1.605998] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 1.606000] PTP clock support registered [ 1.606012] EDAC MC: Ver: 3.0.0 [ 1.606026] NetLabel: Initializing [ 1.606027] NetLabel: domain hash size = 128 [ 1.606027] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 1.606039] NetLabel: unlabeled traffic allowed by default [ 1.606040] PCI: Using ACPI for IRQ routing [ 1.616885] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 1.616885] pci 0000:06:00.0: vgaarb: bridge control possible [ 1.616885] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 1.616885] vgaarb: loaded [ 1.616893] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 1.616897] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 1.622258] clocksource: Switched to clocksource tsc-early [ 1.622729] VFS: Disk quotas dquot_6.6.0 [ 1.622729] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 1.622729] pnp: PnP ACPI init [ 1.622729] system 00:01: [io 0x0500-0x057f] has been reserved [ 1.622729] system 00:01: [io 0x0400-0x047f] has been reserved [ 1.622729] system 00:01: [io 0x0580-0x059f] has been reserved [ 1.622729] system 00:01: [io 0x0600-0x061f] has been reserved [ 1.622729] system 00:01: [io 0x0880-0x0883] has been reserved [ 1.622729] system 00:01: [io 0x0800-0x081f] has been reserved [ 1.622729] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 1.622729] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 1.622729] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 1.622729] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 1.622729] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 1.622729] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 1.622729] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 1.622797] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 1.622799] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 1.622799] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 1.622800] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 1.622801] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 1.624044] pnp: PnP ACPI: found 5 devices [ 1.629721] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 1.629763] NET: Registered PF_INET protocol family [ 1.629943] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.632216] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 1.632247] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 1.632258] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 1.632469] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 1.632579] TCP: Hash tables configured (established 262144 bind 65536) [ 1.632699] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 1.632784] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.632839] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 1.632922] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 1.632926] NET: Registered PF_XDP protocol family [ 1.632956] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 1.632971] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref]: assigned [ 1.632974] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.632980] pci 0000:00:02.0: PCI bridge to [bus 02] [ 1.632981] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 1.632987] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632989] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632990] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632991] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632992] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632993] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632994] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632995] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632996] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632997] pci 0000:03:00.0: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.632998] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.632999] pci 0000:03:00.0: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.633000] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.633001] pci 0000:03:00.1: VF BAR 0 [mem size 0x00100000 64bit pref]: failed to assign [ 1.633002] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: can't assign; no space [ 1.633003] pci 0000:03:00.1: VF BAR 3 [mem size 0x00100000 64bit pref]: failed to assign [ 1.633004] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.633005] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.633007] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.633009] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.633012] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.633026] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.633028] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.633036] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.633052] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.633054] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.633059] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.633069] pci 0000:07:00.0: VF BAR 0 [mem 0x90000000-0x9001ffff 64bit pref]: assigned [ 1.633075] pci 0000:07:00.0: VF BAR 3 [mem 0x90020000-0x9003ffff 64bit pref]: assigned [ 1.633082] pci 0000:07:00.1: VF BAR 0 [mem 0x90040000-0x9005ffff 64bit pref]: assigned [ 1.633088] pci 0000:07:00.1: VF BAR 3 [mem 0x90060000-0x9007ffff 64bit pref]: assigned [ 1.633094] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.633096] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.633101] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.633104] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.633110] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.633111] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.633112] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.633113] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.633113] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.633114] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.633115] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.633116] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.633117] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.633118] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.633118] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.633120] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.633120] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.633121] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.633122] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.633123] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.633123] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.633124] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.633295] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.644908] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x140 took 11169 usecs [ 1.656906] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x140 took 11700 usecs [ 1.656920] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.656953] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.656954] software IO TLB: mapped [mem 0x0000000064000000-0x0000000068000000] (64MB) [ 1.656960] ACPI: bus type thunderbolt registered [ 1.656973] Trying to unpack rootfs image as initramfs... [ 1.719631] Initialise system trusted keyrings [ 1.719640] Key type blacklist registered [ 1.719689] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.721023] zbud: loaded [ 1.795060] integrity: Platform Keyring initialized [ 1.795065] integrity: Machine keyring initialized [ 1.803098] NET: Registered PF_ALG protocol family [ 1.803101] xor: automatically using best checksumming function avx [ 1.803102] Key type asymmetric registered [ 1.803103] Asymmetric key parser 'x509' registered [ 1.803104] Running certificate verification selftests [ 1.804221] Loaded X.509 cert 'Certificate verification self-testing key: f58703bb33ce1b73ee02eccdee5b8817518fe3db' [ 1.804683] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246) [ 1.804722] io scheduler mq-deadline registered [ 1.804724] io scheduler kyber registered [ 1.804764] io scheduler bfq registered [ 1.836400] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.836843] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.837039] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.837214] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.837370] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.837547] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.837709] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.837903] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.844561] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 1.853165] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.853187] ACPI: button: Power Button [PWRB] [ 1.853208] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 1.853240] ACPI: button: Power Button [PWRF] [ 1.861765] ERST: Error Record Serialization Table (ERST) support is initialized. [ 1.861767] pstore: Registered erst as persistent store backend [ 1.861875] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 1.861964] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 1.869385] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 1.878017] Non-volatile memory driver v1.3 [ 1.894323] rdac: device handler registered [ 1.894354] hp_sw: device handler registered [ 1.894355] emc: device handler registered [ 1.894382] alua: device handler registered [ 1.894742] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 1.894782] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 1 [ 1.894796] ehci-pci 0000:00:1d.0: debug port 2 [ 1.898710] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 1.904872] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 1.904914] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.904916] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.904918] usb usb1: Product: EHCI Host Controller [ 1.904918] usb usb1: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.904919] usb usb1: SerialNumber: 0000:00:1d.0 [ 1.905029] hub 1-0:1.0: USB hub found [ 1.905034] hub 1-0:1.0: 2 ports detected [ 1.905176] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.905234] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 2 [ 1.906318] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 1.906523] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 1.906525] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 1.906553] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 1.906555] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 4 [ 1.906555] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 1.906572] ehci-pci 0000:00:1a.0: debug port 2 [ 1.906583] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.906584] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.906585] usb usb2: Product: xHCI Host Controller [ 1.906586] usb usb2: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.906587] usb usb2: SerialNumber: 0000:00:14.0 [ 1.906678] hub 2-0:1.0: USB hub found [ 1.906708] hub 2-0:1.0: 15 ports detected [ 1.909303] usb usb3: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.14 [ 1.909305] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.909305] usb usb3: Product: xHCI Host Controller [ 1.909306] usb usb3: Manufacturer: Linux 5.14.0-438.el9.x86_64 xhci-hcd [ 1.909307] usb usb3: SerialNumber: 0000:00:14.0 [ 1.909371] hub 3-0:1.0: USB hub found [ 1.909387] hub 3-0:1.0: 6 ports detected [ 1.910479] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 1.910718] usbcore: registered new interface driver usbserial_generic [ 1.910722] usbserial: USB Serial support registered for generic [ 1.910749] i8042: PNP: No PS/2 controller found. [ 1.910775] mousedev: PS/2 mouse device common for all mice [ 1.910833] rtc_cmos 00:00: RTC can wake from S4 [ 1.911112] rtc_cmos 00:00: registered as rtc0 [ 1.911158] rtc_cmos 00:00: setting system clock to 2024-04-15T23:37:17 UTC (1713224237) [ 1.911181] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 1.916894] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 1.916921] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.14 [ 1.916923] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 1.916924] usb usb4: Product: EHCI Host Controller [ 1.916925] usb usb4: Manufacturer: Linux 5.14.0-438.el9.x86_64 ehci_hcd [ 1.916926] usb usb4: SerialNumber: 0000:00:1a.0 [ 1.916999] hub 4-0:1.0: USB hub found [ 1.917002] hub 4-0:1.0: 2 ports detected [ 1.919067] intel_pstate: Intel P-state driver initializing [ 1.972364] hid: raw HID events driver (C) Jiri Kosina [ 1.972419] usbcore: registered new interface driver usbhid [ 1.972420] usbhid: USB HID core driver [ 1.972478] drop_monitor: Initializing network drop monitor service [ 1.975539] Freeing initrd memory: 31028K [ 1.982365] Initializing XFRM netlink socket [ 1.982452] NET: Registered PF_INET6 protocol family [ 1.987358] Segment Routing with IPv6 [ 1.987375] NET: Registered PF_PACKET protocol family [ 1.987396] mpls_gso: MPLS GSO support [ 1.999698] microcode: Current revision: 0x0b000010 [ 2.025555] resctrl: L3 allocation detected [ 2.025556] resctrl: L3 monitoring detected [ 2.025572] IPI shorthand broadcast: enabled [ 2.025576] AVX2 version of gcm_enc/dec engaged. [ 2.053431] AES CTR mode by8 optimization enabled [ 2.053488] sched_clock: Marking stable (925119220, 1127743011)->(2393182004, -340319773) [ 2.070036] registered taskstats version 1 [ 2.086690] Loading compiled-in X.509 certificates [ 2.087191] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.087456] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.087714] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.087848] Loaded X.509 cert 'RH-IMA-CA: Red Hat IMA CA: fb31825dd0e073685b264e3038963673f753959a' [ 2.087857] Loaded X.509 cert 'Nvidia GPU OOT signing 001: 55e1cef88193e60419f0b0ec379c49f77545acf0' [ 2.088045] zswap: loaded using pool lzo/zbud [ 2.105114] page_owner is disabled [ 2.105283] pstore: Using crash dump compression: deflate [ 2.105292] Key type big_key registered [ 2.145896] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.166891] usb 2-12: new high-speed USB device number 2 using xhci_hcd [ 2.179898] usb 4-1: new high-speed USB device number 2 using ehci-pci [ 2.241500] Key type encrypted registered [ 2.241506] ima: No TPM chip found, activating TPM-bypass! [ 2.241511] Loading compiled-in module X.509 certificates [ 2.241797] Loaded X.509 cert 'The CentOS Project: CentOS Stream kernel signing key: faa4bf22e8b8f5615a706c4f4779335bd2c78a01' [ 2.241799] ima: Allocated hash algorithm: sha256 [ 2.241808] ima: No architecture policies found [ 2.241815] evm: Initialising EVM extended attributes: [ 2.241815] evm: security.selinux [ 2.241816] evm: security.SMACK64 (disabled) [ 2.241816] evm: security.SMACK64EXEC (disabled) [ 2.241817] evm: security.SMACK64TRANSMUTE (disabled) [ 2.241817] evm: security.SMACK64MMAP (disabled) [ 2.241818] evm: security.apparmor (disabled) [ 2.241818] evm: security.ima [ 2.241819] evm: security.capability [ 2.241819] evm: HMAC attrs: 0x1 [ 2.284065] usb 1-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.284067] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.285094] hub 1-1:1.0: USB hub found [ 2.285512] hub 1-1:1.0: 8 ports detected [ 2.297044] usb 2-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.297047] usb 2-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.297553] hub 2-12:1.0: USB hub found [ 2.297630] hub 2-12:1.0: 4 ports detected [ 2.317287] usb 4-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.317289] usb 4-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.317439] hub 4-1:1.0: USB hub found [ 2.317536] hub 4-1:1.0: 6 ports detected [ 2.608868] usb 2-12.1: new low-speed USB device number 3 using xhci_hcd [ 2.700874] tsc: Refined TSC clocksource calibration: 3499.992 MHz [ 2.700877] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x327349661d8, max_idle_ns: 440795222604 ns [ 2.703072] clocksource: Switched to clocksource tsc [ 2.712225] usb 2-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 2.712227] usb 2-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.717251] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.0/0003:0557:2419.0001/input/input2 [ 2.768996] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 2.771646] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb2/2-12/2-12.1/2-12.1:1.1/0003:0557:2419.0002/input/input3 [ 2.771729] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 5.230030] Freeing unused decrypted memory: 2028K [ 5.230466] Freeing unused kernel image (initmem) memory: 3932K [ 5.230504] Write protecting the kernel read-only data: 28672k [ 5.230674] Freeing unused kernel image (rodata/data gap) memory: 492K [ 5.271521] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.271522] x86/mm: Checking user space page tables [ 5.310244] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.310254] Run /init as init process [ 5.323809] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 5.323931] systemd[1]: Detected architecture x86-64. [ 5.323932] systemd[1]: Running in initrd. Welcome to CentOS Stream 9 dracut-057-44.git20230822.el9 (Initramfs)! [ 5.374976] systemd[1]: Hostname set to . [ OK [[ 5.432214] systemd[1]: Queued start job for default target Initrd Default Target. [ 5.432323] systemd[1]: Reached target Initrd /usr File System. 0m] Reached target Initrd /usr File System. [ OK [[ 5.454023] systemd[1]: Reached target Local File Systems. 0m] Reached target Local File Systems. [ OK [[ 5.468070] systemd[1]: Reached target Slice Units. 0m] Reached target Slice Units. [ OK [[ 5.480002] systemd[1]: Reached target Swaps. 0m] Reached target Swaps. [ OK [[ 5.490994] systemd[1]: Reached target Timer Units. 0m] Reached target Timer Units. [ OK [[ 5.503008] systemd[1]: Listening on D-Bus System Message Bus Socket. 0m] Listening on D-Bus System Message Bus Socket. [ OK [[ 5.518002] systemd[1]: Listening on Journal Socket (/dev/log). 0m] Listening on Journal Socket (/dev/log). [ OK [[ 5.532030] systemd[1]: Listening on Journal Socket. 0m] Listening on Journal Socket. [ OK [[ 5.544154] systemd[1]: Listening on udev Control Socket. 0m] Listening on udev Control Socket. [ OK [[ 5.558154] systemd[1]: Listening on udev Kernel Socket. 0m] Listening on udev Kernel Socket. [ OK [[ 5.571932] systemd[1]: Reached target Socket Units. 0m] Reached target Socket Units. Startin[ 5.590597] systemd[1]: Starting Create List of Static Device Nodes... g Create List of Static Device Nodes... Startin[ 5.606112] systemd[1]: Starting Journal Service... g Journal Service... Startin[ 5.618587] systemd[1]: Starting Load Kernel Modules... g Load Kernel Modules... [ 5.634225] fuse: init (API version 7.36) Startin[ 5.640003] systemd[1]: Starting Create System Users... g Create System Users... Startin[ 5.652676] systemd[1]: Starting Setup Virtual Console... g Setup Virtual Console... [ OK [[ 5.665610] systemd[1]: Started Journal Service. 0m] Started Journal Service. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Modules. Starting Apply Kernel Variables... [ OK ] Finished Setup Virtual Console. [ OK ] Finished Apply Kernel Variables. Starting dracut cmdline hook... [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... Starting Create Volatile Files and Directories... [ OK ] Finished dracut cmdline hook. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Finished Create Volatile Files and Directories. Starting dracut pre-udev hook... [ OK ] Finished dracut pre-udev hook. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. Starting Coldplug All udev Devices... [ OK ] Finished Coldplug All udev Devices. [ OK ] Reached target System Initialization. [ OK ] Reached target Network. Starting dracut initqueue hook... [ 6.045414] dca service started, version 1.12.1 Starting Show Plymouth Boot Screen... [ OK ] Started Show Plymouth Boot Screen. [ OK ] Started Forward Password R…s to Plymouth Directory Watch. [ OK ] Reached target Path Units. [ OK ] Reached target Basic System. [ 6.103420] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 6.103423] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 6.103455] igb: Intel(R) Gigabit Ethernet Network Driver [ 6.103457] igb: Copyright (c) 2007-2014 Intel Corporation. [ 6.128455] nvme nvme0: pci function 0000:02:00.0 [ 6.135927] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 6.135930] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.136401] nvme nvme0: 8/0/0 default/read/poll queues [ 6.146226] scsi host0: ahci [ 6.146550] scsi host1: ahci [ 6.146852] scsi host2: ahci [ 6.147199] scsi host3: ahci [ 6.147242] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 44 lpm-pol 0 [ 6.147244] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 44 lpm-pol 0 [ 6.147248] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 44 lpm-pol 0 [ 6.147250] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 44 lpm-pol 0 [ 6.147609] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 6.147613] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 6.160945] ACPI: bus type drm_connector registered [ 6.162251] scsi host4: ahci [ 6.162378] scsi host5: ahci [ 6.162553] scsi host6: ahci [ 6.162781] scsi host7: ahci [ 6.163213] scsi host8: ahci [ 6.163446] scsi host9: ahci [ 6.163510] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 lpm-pol 0 [ 6.163512] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 lpm-pol 0 [ 6.163514] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 lpm-pol 0 [ 6.163517] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 lpm-pol 0 [ 6.163521] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 lpm-pol 0 [ 6.163525] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 lpm-pol 0 [ 6.182499] igb 0000:07:00.0: added PHC on eth0 [ 6.182529] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 6.182531] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:44 [ 6.182606] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 6.182607] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.229390] ast 0000:06:00.0: vgaarb: deactivate vga console [ 6.236386] igb 0000:07:00.1: added PHC on eth1 [ 6.236416] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.236417] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a5:45 [ 6.236503] igb 0000:07:00.1: et6503] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.237562] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.246160] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.249807] Console: switching to colour dummy device 80x25 [ 6.249967] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 6.249968] ast 0000:06:00.0: [drm] AST 2400 detected [ 6.249984] ast 0000:06:00.0: [drm] Using analog VGA [ 6.249993] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 6.250142] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 6.257436] fbcon: astdrmfb (fb0) is primary device [ 6.282019] Console: switching to colour frame buffer device 128x48 [ 6.300909] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 6.458251] ata4: SATA link down (SStatus 0 SControl 300) [ 6.458280] ata3: SATA link down (SStatus 0 SControl 300) [ 6.458590] ata1: SATA link down (SStatus 0 SControl 300) [ 6.458650] ata2: SATA link down (SStatus 0 SControl 300) [ 6.475772] ata7: SATA link down (SStatus 0 SControl 300) [ 6.476038] ata8: SATA link down (SStatus 0 SControl 300) [ 6.476058] ata9: SATA link down (SStatus 0 SControl 300) [ 6.476141] ata6: SATA link down (SStatus 0 SControl 300) [ta10: SATA link rol 300) [ 6TA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.477191] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.477679] ata5.00: NCQ Send/Recv Log not supported [ 6.477680] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.479133] ata5.00: NCQ Send/Recv Log not supported [ 6.479136] ata5.00: configured for UDMA/133 [ 6.479229] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.543792] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.622711] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.622726] sd 4:0:0:0: [sda] Write Protect is off [ 6.622746] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.622770] sd 4:0:0:0: [sda] Preferred minimum I/O size 512 bytes [ 6.630212] sda: sda1 [ 6.630301] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 7.242180] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.242468] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.242550] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.242551] ixgbe 0000:03:00.0: 0c:c4:7a:8f:ce:8e [ 7.245729] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.402148] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.402434] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.402516] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.402517] ixgbe 0000:03:00.1: 0c:c4:7a:8f:ce:8f [ 7.405684] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.413692] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 7.447440] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Finished dracut initqueue hook. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting File System Check…7844-4e73-a652-6bb884dfb0a5... [ OK ] Finished File System Check…0-7844-4e73-a652-6bb884dfb0a5. Mounting /sysroot... [ OK [[ 7.695962] EXT4-fs (sda1): mounted filesystem 0b261d40-7844-4e73-a652-6bb884dfb0a5 ro with ordered data mode. Quota mode: none. 0m] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Mountpoints Configured in the Real Root... [ OK ] Finished Mountpoints Configured in the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Finished dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped target Network. [ OK ] Stopped target Timer Units. [ OK ] Closed D-Bus System Message Bus Socket. [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Basic System. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Initrd /usr File System. [ OK ] Stopped target Path Units. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Preparation for Remote File Systems. [ OK ] Stopped target Slice Units. [ OK ] Stopped target Socket Units. [ OK ] Stopped target System Initialization. [ OK ] Stopped target Local File Systems. [ OK ] Stopped target Swaps. [ OK ] Stopped dracut initqueue hook. Starting Plymouth switch root service... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped Load Kernel Modules. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped Coldplug All udev Devices. Stopping Rule-based Manage…for Device Events and Files... [ OK ] Stopped Rule-based Manager for Device Events and Files. [ OK ] Finished Cleaning Up and Shutting Down Daemons. [ OK ] Closed udev Control Socket. [ OK ] Closed udev Kernel Socket. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. Starting Cleanup udev Database... [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create List of Static Device Nodes. [ OK ] Stopped Create System Users. [ OK ] Finished Cleanup udev Database. [ OK ] Reached target Switch Root. [ OK ] Finished Plymouth switch root service. Starting Swi[ 8.034068] systemd-journald[281]: Received SIGTERM from PID 1 (systemd). tch Root... [ 8.553700] SELinux: policy capability network_peer_controls=1 [ 8.553703] SELinux: policy capability open_perms=1 [ 8.553704] SELinux: policy capability extended_socket_class=1 [ 8.553704] SELinux: policy capability always_check_network=0 [ 8.553705] SELinux: policy capability cgroup_seclabel=1 [ 8.553705] SELinux: policy capability nnp_nosuid_transition=1 [ 8.553705] SELinux: policy capability genfs_seclabel_symlinks=1 [ 8.597279] audit: type=1403 audit(1713224244.184:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 8.608611] systemd[1]: Successfully loaded SELinux policy in 119.392ms. [ 8.704391] systemd[1]: Relabelled /dev, /dev/shm, /run, /sys/fs/cgroup in 31.075ms. [ 8.733673] systemd[1]: systemd 252-18.el9 running in system mode (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN -IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 8.733782] systemd[1]: Detected architecture x86-64. Welcome to CentOS Stream 9! [ OK [[ 9.798009] systemd[1]: initrd-switch-root.service: Deactivated successfully. [ 9.798120] systemd[1]: Stopped Switch Root. 0m] Stopped [0;[ 9.798539] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. [ 9.798847] systemd[1]: Created slice Slice /system/getty. 1;39mSwitch Root[ 9.799163] systemd[1]: Created slice Slice /system/modprobe. [ 9.811460] systemd[1]: Created slice Slice /system/serial-getty. . [[ 9.840368] systemd[1]: Created slice Slice /system/sshd-keygen. OK ] Crea[ 9.840633] systemd[1]: Created slice User and Session Slice. [ 9.840662] systemd[1]: Dispatch Password Requests to Console Directory Watch was skipped because of an unmet condition check (ConditionPathExists=!/run/plymouth/pid). ted slice [0;1;[ 9.840757] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ 9.841121] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. 39mSlice /system[ 9.847569] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. /getty. [[ 9.899648] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ 9.899675] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [0;32m OK [ 9.899689] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. ] Created slice [ 9.899703] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ 9.899729] systemd[1]: Reached target ceph target allowing to start/stop all ceph-rbd-mirror@.service instances at once. Slice /[ 9.899748] systemd[1]: Reached target Local Encrypted Volumes. [ 9.899773] systemd[1]: Stopped target Switch Root. system/modprobe[ 9.899791] systemd[1]: Stopped target Initrd File Systems. [ 9.899805] systemd[1]: Stopped target Initrd Root File System. [0m. [ [ 9.899821] systemd[1]: Reached target Local Integrity Protected Volumes. [ 9.899853] systemd[1]: Reached target Path Units. OK ] Creat[ 9.899887] systemd[1]: Reached target Slice Units. [ 9.933426] systemd[1]: Reached target Swaps. ed slice [0;1;3[ 9.933451] systemd[1]: Reached target Local Verity Protected Volumes. [ 9.956823] systemd[1]: Listening on Device-mapper event daemon FIFOs. 9mSlice /system/[ 9.964378] systemd[1]: Listening on LVM2 poll daemon socket. serial-getty. [ OK ] Created slice S[ 10.030331] systemd[1]: Listening on RPCbind Server Activation Socket. lice /system/ssh[ 10.030387] systemd[1]: Reached target RPC Port Mapper. [ 10.037849] systemd[1]: Listening on Process Core Dump Socket. d-keygen. [ 10.038718] systemd[1]: Listening on initctl Compatibility Named Pipe. [ 10.052024] systemd[1]: Listening on udev Control Socket. [ OK [[ 10.064586] systemd[1]: Listening on udev Kernel Socket. 0m] Created slic[ 10.065456] systemd[1]: Mounting Huge Pages File System... [ 10.071874] systemd[1]: Mounting POSIX Message Queue File System... e User and Session Slic[ 10.085370] systemd[1]: Mounting Kernel Debug File System... [ 10.086237] systemd[1]: Mounting Kernel Trace File System... e. [[0;32[ 10.098314] systemd[1]: Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab). m OK ] Sta[ 10.111523] systemd[1]: Starting Create List of Static Device Nodes... [ 10.113584] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... rted Fo[ 10.131746] systemd[1]: Starting Load Kernel Module configfs... [ 10.132524] systemd[1]: Starting Load Kernel Module drm... rward Password R[ 10.139042] systemd[1]: Starting Load Kernel Module fuse... …uests to Wall Directory Watch. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ [ 10.162396] systemd[1]: Starting Read and set NIS domainname from /etc/sysconfig/network... OK ] Reach[ 10.162462] systemd[1]: plymouth-switch-root.service: Deactivated successfully. [ 10.162504] systemd[1]: Stopped Plymouth switch root service. ed target [0;1;[ 10.162682] systemd[1]: Stopped Journal Service. 39mceph target\xe2\x80[ 10.192436] systemd[1]: Starting Journal Service... \xa6on@.service ins[ 10.194877] systemd[1]: Starting Load Kernel Modules... [ 10.198969] systemd[1]: Starting Generate network units from Kernel command line... tances at once. [ [ 10.213399] systemd[1]: Starting Remount Root and Kernel File Systems... OK ] Reache[ 10.213502] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met. [ 10.214486] systemd[1]: Starting Coldplug All udev Devices... d target [0;1;3[ 10.223347] systemd[1]: Mounted Huge Pages File System. [ 10.243474] EXT4-fs (sda1): re-mounted 0b261d40-7844-4e73-a652-6bb884dfb0a5 r/w. Quota mode: none. 9mceph target…[ 10.245685] systemd[1]: Mounted POSIX Message Queue File System. ds@.service inst[ 10.254201] systemd[1]: Mounted Kernel Debug File System. ances at once[0[ 10.268444] systemd[1]: Started Journal Service. m. [ OK ] Reached target ceph target…gr@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ OK ] Reached target ceph target…or@.service instances at once. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. [ OK ] Stopped target Initrd Root File System. [ OK ] Reached target Local Integrity Protected Volumes. [ OK ] Reached target Path Units. [ OK ] Reached targ[ 10.346539] systemd-journald[578]: Received client request to flush runtime journal. et Slice Units. [ OK ] Reached target Swaps. [ OK ] Reached target Local Verity Protected Volumes. [ OK ] Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Listening on udev Control Socket. [ OK ] Listening on udev Kernel Socket. Mounting Huge Pages File System... Mounting POSIX Message Queue File System... Mounting Kernel Debug File System... Mounting Kernel Trace File System[[ 10.441710] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. 0m... [ 10.441728] device-mapper: uevent: version 1.0.3 [ 10.441831] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com Starting Create List of Static Device Nodes... Starting Monitoring of LVM…meventd or progress polling... Starting Load Kernel Module configfs... Starting Load Kernel Module drm... Starting Load Kernel Module fuse... Starting Read and set NIS …from /etc/sysconfig/network... [ OK ] Stopped Plymouth switch root service. [ OK ] Stopped Journal Service. Starting Journal Service... Starting Load Kernel Modules... Starting Generate network …ts from Kernel command line... Starting Remount Root and Kernel File Systems... Starting Coldplug All udev Devices... [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Started Journal Service. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Read and set NIS …e from /etc/sysconfig/network. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Generate network units from Kernel command line. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Reached target Preparation for Network. Mounting FUSE Control File System... Starting Flush Journal to Persistent Storage... Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create Static Device Nodes in /dev... [ OK ] Finished Load Kernel Module configfs. [ OK ] Mounted FUSE Control File System. Mounting Kernel Configuration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Coldplug All udev Devices. [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Create Static Device Nodes in /dev. Starting Rule-based Manage…for Device Events and Files... [ OK ] Started Rule-based Manager for Device Events and Files. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Tell Plymouth To Write Out Runtime Data... Starting Automatic Boot Loader Update... Starting Create Volatile Files and Directories... Starting Load Kernel Module configfs... Starting Load Kernel Module fuse... [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Automatic Boot Loader Update. [ 10.881476] IPMI message handler: version 39.2 [ 10.886395] ipmi device interface [ 10.899294] ipmi_si: IPMI System Interface driver [ 10.899305] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 10.899307] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 10.899309] ipmi_si: Adding SMBIOS-specified kcs state machine [ 10.899348] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 10.899417] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 [ 10.899706] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 10.899707] ipmi_si: Adding ACPI-specified kcs state machine [ 10.899750] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 10.962985] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ 10.969900] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ 10.972898] igb 0000:07:00.0: DCA enabled [ 10.972915] igb 0000:07:00.1: DCA enabled [ 10.973190] power_meter ACPI000D:00: Found ACPI power meter. [ 10.973211] power_meter ACPI000D:00: Ignoring unsafe software power cap! [ 10.973216] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info(). [ 10.976878] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 11.018575] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 11.033409] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 11.034407] i2c i2c-3: 2/8 memory slots populated (from DMI) [ 11.034410] i2c i2c-3: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 11.069577] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 11.069580] RAPL PMU: hw unit of domain package 2^-14 Joules [ 11.069581] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 11.091147] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 11.106361] iTCO_vendor_support: vendor-support=0 [ 11.115550] iTCO_wdt iTCO_wdt.1.auto: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) [ 11.115845] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) [ OK ] Started /usr/sbin/lvm vgch…-autoactivation event vg_nvme. [ 11.182392] ipmi_si IPI0001:00: IPMI kcs interface initialized [ OK ] Finished Create Volatile Files and Directories. [ 11.292068] ipmi_ssif: IPMI SSIF Interface driver Starting Security Auditing Service... Starting RPC Bind... [ OK ] Found device /dev/vg_nvme/lv_5. Mounting /var/lib/ceph... Mounting RPC Pipe File System... [ 11.484516] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 11.484517] EDAC sbridge: Ver: 1.1.2 [ 11.491097] RPC: Registered named UNIX socket transport module. [ 11.491099] RPC: Registered udp transport module. [ 11.491100] RPC: Registered tcp transport module. [ 11.491101] RPC: Registered tcp-with-tls transport module. [ 11.491101] RPC: Registered tcp NFSv4.1 backchannel transport module. [ OK ] Mounted RPC Pipe File System. [ OK ] Reached target rpc_pipefs.target. [ OK ] Started RPC Bind. [ 11.742589] intel_rapl_common: Found RAPL domain package [ 11.742594] intel_rapl_common: Found RAPL domain dram [ 11.742825] SGI XFS with ACLs, security attributes, scrub, quota, no debug enabled [ 11.753933] XFS (dm-4): Deprecated V4 format (crc=0) will not be supported after September 2030. [ 11.754045] XFS (dm-4): Mounting V4 Filesystem d6c01728-66b3-4325-83c2-85b28a05635d [ 11.758344] XFS (dm-4): Ending clean mount [ 11.758384] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff) [ OK ] Mounted /var/lib/ceph. [ OK ] Started Security Auditing Service. Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Reached target System Initialization. [ OK ] Started Daily rotation of log files. [ OK ] Started Updates mlocate database every day. [ OK ] Started Run system activit…ounting tool every 10 minutes. [ OK ] Started Generate summary o…esterday's process accounting. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on SSSD Kerberos…ache Manager responder socket. [ OK ] Reached target Socket Units. Starting D-Bus System Message Bus... [ OK ] Started D-Bus System Message Bus. [ OK ] Reached target Basic System. Starting Network Manager... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. Starting NTP client/server... Starting Restore /run/initramfs on shutdown... [ OK ] Started irqbalance daemon. [ OK ] Started libstoragemgmt plug-in server daemon. [ OK ] Started Machine Check Exception Logging Daemon. Starting Authorization Manager... Starting Self Monitoring a…g Technology (SMART) Daemon... [ OK ] Reached target sshd-keygen.target. [ OK ] Reached target User and Group Name Lookups. Starting Resets System Activity Logs... Starting User Login Management... [ OK ] Finished Restore /run/initramfs on shutdown. [ OK ] Finished Resets System Activity Logs. [ OK ] Started User Login Management. [ OK ] Started NTP client/server. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started Authorization Manager. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Starting Network Manager Script Dispatcher Service... [ OK ] Started Network Manager Script Dispatcher Service. [ 15.810836] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 15.967560] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ OK ] Started Network Manager. [ OK ] Reached target Network. Starting Network Manager Wait Online... Starting GSSAPI Proxy Daemon... Starting OpenSSH server daemon... Starting Dynamic System Tuning Daemon... [ 16.192913] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started OpenSSH server daemon. [ 16.276936] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX [ 16.277040] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting Permit User Sessions... [ OK ] Finished Permit User Sessions. [ OK ] Started Deferred execution scheduler. [ OK ] Started Command Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [* ] A start job is running for Network Manager Wait Online (9s / no limit) M [** ] A start job is running for Network Manager Wait Online (9s / no limit) M [*** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (10s / no limit) M [ *** ] A start job is running for Network …nager Wait Online (11s / no limit) M [ ***] A start job is running for Network …nager Wait Online (11s / no limit) M [ OK ] Finished Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... Starting System Logging Service... [ OK ] Started Notify NFS peers of a restart. + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.115 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. Starting SETroubleshoot da…ing new SELinux denial logs... + '[' 172.21.15.115 '!=' '' ']' + set -e + '[' -n 172.21.15.115 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.115 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.115 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi115.front.sepia.ceph.com + '[' -n smithi115.front.sepia.ceph.com ']' + hostname smithi115.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi115 + echo smithi115 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.115 smithi115.front.sepia.ceph.com smithi115/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ 26.316466] block sda: the capability attribute has been deprecated. CentOS Stream 9 Kernel 5.14.0-438.el9.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi115 login: [disconnect] 2024-04-15T23:37:45.394 INFO:teuthology.misc:Re-opening connections... 2024-04-15T23:37:45.394 INFO:teuthology.misc:trying to connect to ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:37:45.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:37:45.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T23:37:45.816 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-15T23:37:46.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-15T23:37:46.350 DEBUG:teuthology.misc:waited 0.9555377960205078 2024-04-15T23:37:47.351 DEBUG:tasks.ceph_manager:Mounting data for osd.1 on ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:37:47.351 INFO:tasks.ceph_manager:Mounting osd.1: dev: ubuntu@smithi115.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-1, type: xfs, options: ['noatime'] 2024-04-15T23:37:47.351 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-15T23:37:47.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~139s 2024-04-15T23:37:47.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-04-15T23:37:47.517 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-15T23:37:47.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-15T23:37:47.520 INFO:tasks.ceph.osd.1:Started 2024-04-15T23:37:47.520 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:37:47.621 INFO:teuthology.orchestra.run.smithi115.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-15T23:37:47.624 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-15T23:37:47.624 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-15T23:37:48.500 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:37:48.517+0000 7fa877193640 -1 Falling back to public interface 2024-04-15T23:37:52.282 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:37:52.298+0000 7fa877193640 -1 osd.1 68 log_to_monitors true 2024-04-15T23:37:52.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:37:52.732 INFO:teuthology.orchestra.run.smithi115.stderr:no valid command found; 10 closest matches: 2024-04-15T23:37:52.732 INFO:teuthology.orchestra.run.smithi115.stderr:0 2024-04-15T23:37:52.732 INFO:teuthology.orchestra.run.smithi115.stderr:1 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:2 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:abort 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:assert 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:bluefs debug_inject_read_zeros 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:bluefs files list 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:bluefs stats 2024-04-15T23:37:52.733 INFO:teuthology.orchestra.run.smithi115.stderr:bluestore allocator dump block 2024-04-15T23:37:52.734 INFO:teuthology.orchestra.run.smithi115.stderr:bluestore allocator fragmentation block 2024-04-15T23:37:52.734 INFO:teuthology.orchestra.run.smithi115.stderr:admin_socket: invalid command 2024-04-15T23:37:52.734 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-15T23:37:52.735 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-04-15T23:37:52.965 INFO:tasks.ceph.osd.1.smithi115.stderr:2024-04-15T23:37:52.981+0000 7fa86af38640 -1 osd.1 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-15T23:37:53.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-15T23:37:57.736 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-15T23:37:57.858 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-15T23:37:57.858 INFO:teuthology.orchestra.run.smithi115.stdout: "ops": [], 2024-04-15T23:37:57.858 INFO:teuthology.orchestra.run.smithi115.stdout: "num_ops": 0 2024-04-15T23:37:57.858 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-15T23:37:57.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-15T23:37:57.993 INFO:teuthology.orchestra.run.smithi102.stdout:mon.a: {} 2024-04-15T23:37:57.993 INFO:teuthology.orchestra.run.smithi102.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-15T23:37:58.002 INFO:teuthology.orchestra.run.smithi102.stdout:mon.b: {} 2024-04-15T23:37:58.002 INFO:teuthology.orchestra.run.smithi102.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-15T23:37:58.013 INFO:teuthology.orchestra.run.smithi102.stdout:mon.c: {} 2024-04-15T23:37:58.014 INFO:teuthology.orchestra.run.smithi102.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-15T23:37:58.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-15T23:37:59.015 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.0 to 1 (10000) 2024-04-15T23:37:59.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-15T23:38:00.014 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-15T23:38:00.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-15T23:38:01.019 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.2 to 1 (10000) 2024-04-15T23:38:01.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-15T23:38:02.023 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-15T23:38:02.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-15T23:38:03.028 INFO:teuthology.orchestra.run.smithi102.stderr:reweighted osd.1 to 1 (10000) 2024-04-15T23:38:03.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-15T23:38:04.034 INFO:teuthology.orchestra.run.smithi102.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-15T23:38:04.050 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-15T23:38:04.050 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-15T23:38:04.050 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-15T23:38:04.051 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-15T23:38:04.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-15T23:38:04.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:38:04.339 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:04.339 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":79,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:38:04.051016+0000","last_up_change":"2024-04-15T23:37:53.955442+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":68,"up_from":72,"up_thru":72,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6801","nonce":2789808517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6803","nonce":2789808517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6807","nonce":2789808517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6805","nonce":2789808517}]},"public_addr":"172.21.15.115:6801/2789808517","cluster_addr":"172.21.15.115:6803/2789808517","heartbeat_back_addr":"172.21.15.115:6807/2789808517","heartbeat_front_addr":"172.21.15.115:6805/2789808517","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":23,"up_from":58,"up_thru":72,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6801","nonce":3430252970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6803","nonce":3430252970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6807","nonce":3430252970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6805","nonce":3430252970}]},"public_addr":"172.21.15.195:6801/3430252970","cluster_addr":"172.21.15.195:6803/3430252970","heartbeat_back_addr":"172.21.15.195:6807/3430252970","heartbeat_front_addr":"172.21.15.195:6805/3430252970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":23}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:38:04.352 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-15T23:38:04.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:38:04.640 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:04.640 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":79,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:38:04.051016+0000","last_up_change":"2024-04-15T23:37:53.955442+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":68,"up_from":72,"up_thru":72,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6801","nonce":2789808517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6803","nonce":2789808517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6807","nonce":2789808517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6805","nonce":2789808517}]},"public_addr":"172.21.15.115:6801/2789808517","cluster_addr":"172.21.15.115:6803/2789808517","heartbeat_back_addr":"172.21.15.115:6807/2789808517","heartbeat_front_addr":"172.21.15.115:6805/2789808517","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":23,"up_from":58,"up_thru":72,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6801","nonce":3430252970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6803","nonce":3430252970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6807","nonce":3430252970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6805","nonce":3430252970}]},"public_addr":"172.21.15.195:6801/3430252970","cluster_addr":"172.21.15.195:6803/3430252970","heartbeat_back_addr":"172.21.15.195:6807/3430252970","heartbeat_front_addr":"172.21.15.195:6805/3430252970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":23}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:38:04.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-15T23:38:04.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-15T23:38:04.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-15T23:38:04.804 INFO:teuthology.orchestra.run.smithi102.stdout:34359738451 2024-04-15T23:38:04.805 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T23:38:04.808 INFO:teuthology.orchestra.run.smithi102.stdout:249108103205 2024-04-15T23:38:04.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T23:38:04.809 INFO:teuthology.orchestra.run.smithi102.stdout:309237645316 2024-04-15T23:38:04.810 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T23:38:05.113 INFO:teuthology.orchestra.run.smithi102.stdout:34359738450 2024-04-15T23:38:05.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738451 got 34359738450 for osd.0 2024-04-15T23:38:05.152 INFO:teuthology.orchestra.run.smithi102.stdout:309237645315 2024-04-15T23:38:05.158 INFO:teuthology.orchestra.run.smithi102.stdout:249108103204 2024-04-15T23:38:05.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645316 got 309237645315 for osd.1 2024-04-15T23:38:05.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 249108103205 got 249108103204 for osd.2 2024-04-15T23:38:06.127 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-15T23:38:06.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-15T23:38:06.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-15T23:38:06.447 INFO:teuthology.orchestra.run.smithi102.stdout:34359738451 2024-04-15T23:38:06.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738451 got 34359738451 for osd.0 2024-04-15T23:38:06.461 DEBUG:teuthology.parallel:result is None 2024-04-15T23:38:06.482 INFO:teuthology.orchestra.run.smithi102.stdout:249108103205 2024-04-15T23:38:06.498 INFO:teuthology.orchestra.run.smithi102.stdout:309237645316 2024-04-15T23:38:06.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 249108103205 got 249108103205 for osd.2 2024-04-15T23:38:06.499 DEBUG:teuthology.parallel:result is None 2024-04-15T23:38:06.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 309237645316 got 309237645316 for osd.1 2024-04-15T23:38:06.511 DEBUG:teuthology.parallel:result is None 2024-04-15T23:38:06.511 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-15T23:38:06.512 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:06.843 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:06.845 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:06.853 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-15T23:38:05.881474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255328,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860192,"statfs":{"total":289910292480,"available":289648836608,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.846081"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055400+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:38:04.055400+0000","last_peered":"2024-04-15T23:38:04.055400+0000","last_clean":"2024-04-15T23:38:04.055400+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:04.055400+0000","last_undegraded":"2024-04-15T23:38:04.055400+0000","last_fullsized":"2024-04-15T23:38:04.055400+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055039+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:38:04.055039+0000","last_peered":"2024-04-15T23:38:04.055039+0000","last_clean":"2024-04-15T23:38:04.055039+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:04.055039+0000","last_undegraded":"2024-04-15T23:38:04.055039+0000","last_fullsized":"2024-04-15T23:38:04.055039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151265+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151265+0000","last_peered":"2024-04-15T23:38:04.151265+0000","last_clean":"2024-04-15T23:38:04.151265+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151265+0000","last_undegraded":"2024-04-15T23:38:04.151265+0000","last_fullsized":"2024-04-15T23:38:04.151265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:18:46.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":446,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150655+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150655+0000","last_peered":"2024-04-15T23:38:04.150655+0000","last_clean":"2024-04-15T23:38:04.150655+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150655+0000","last_undegraded":"2024-04-15T23:38:04.150655+0000","last_fullsized":"2024-04-15T23:38:04.150655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:06:46.388157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150937+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.150937+0000","last_peered":"2024-04-15T23:38:04.150937+0000","last_clean":"2024-04-15T23:38:04.150937+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.150937+0000","last_undegraded":"2024-04-15T23:38:04.150937+0000","last_fullsized":"2024-04-15T23:38:04.150937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:49:46.849666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:57.967361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":461,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150156+0000","last_change":"2024-04-15T23:37:54.979553+0000","last_active":"2024-04-15T23:38:04.150156+0000","last_peered":"2024-04-15T23:38:04.150156+0000","last_clean":"2024-04-15T23:38:04.150156+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:04.150156+0000","last_undegraded":"2024-04-15T23:38:04.150156+0000","last_fullsized":"2024-04-15T23:38:04.150156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:10:07.716446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055404+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:38:04.055404+0000","last_peered":"2024-04-15T23:38:04.055404+0000","last_clean":"2024-04-15T23:38:04.055404+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:04.055404+0000","last_undegraded":"2024-04-15T23:38:04.055404+0000","last_fullsized":"2024-04-15T23:38:04.055404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055091+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:38:04.055091+0000","last_peered":"2024-04-15T23:38:04.055091+0000","last_clean":"2024-04-15T23:38:04.055091+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:04.055091+0000","last_undegraded":"2024-04-15T23:38:04.055091+0000","last_fullsized":"2024-04-15T23:38:04.055091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":495,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151157+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151157+0000","last_peered":"2024-04-15T23:38:04.151157+0000","last_clean":"2024-04-15T23:38:04.151157+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151157+0000","last_undegraded":"2024-04-15T23:38:04.151157+0000","last_fullsized":"2024-04-15T23:38:04.151157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:44.888221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:37:54.980913+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:05.402863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":462,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054625+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:38:04.054625+0000","last_peered":"2024-04-15T23:38:04.054625+0000","last_clean":"2024-04-15T23:38:04.054625+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:04.054625+0000","last_undegraded":"2024-04-15T23:38:04.054625+0000","last_fullsized":"2024-04-15T23:38:04.054625+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":288,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150828+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150828+0000","last_peered":"2024-04-15T23:38:04.150828+0000","last_clean":"2024-04-15T23:38:04.150828+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150828+0000","last_undegraded":"2024-04-15T23:38:04.150828+0000","last_fullsized":"2024-04-15T23:38:04.150828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:13:18.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150330+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150330+0000","last_peered":"2024-04-15T23:38:04.150330+0000","last_clean":"2024-04-15T23:38:04.150330+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150330+0000","last_undegraded":"2024-04-15T23:38:04.150330+0000","last_fullsized":"2024-04-15T23:38:04.150330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:29:51.531478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":547,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150536+0000","last_change":"2024-04-15T23:37:54.977342+0000","last_active":"2024-04-15T23:38:04.150536+0000","last_peered":"2024-04-15T23:38:04.150536+0000","last_clean":"2024-04-15T23:38:04.150536+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:04.150536+0000","last_undegraded":"2024-04-15T23:38:04.150536+0000","last_fullsized":"2024-04-15T23:38:04.150536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:08:13.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055354+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:38:04.055354+0000","last_peered":"2024-04-15T23:38:04.055354+0000","last_clean":"2024-04-15T23:38:04.055354+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:04.055354+0000","last_undegraded":"2024-04-15T23:38:04.055354+0000","last_fullsized":"2024-04-15T23:38:04.055354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055324+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:38:04.055324+0000","last_peered":"2024-04-15T23:38:04.055324+0000","last_clean":"2024-04-15T23:38:04.055324+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:04.055324+0000","last_undegraded":"2024-04-15T23:38:04.055324+0000","last_fullsized":"2024-04-15T23:38:04.055324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":252,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054942+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:38:04.054942+0000","last_peered":"2024-04-15T23:38:04.054942+0000","last_clean":"2024-04-15T23:38:04.054942+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:04.054942+0000","last_undegraded":"2024-04-15T23:38:04.054942+0000","last_fullsized":"2024-04-15T23:38:04.054942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150860+0000","last_change":"2024-04-15T23:37:54.974826+0000","last_active":"2024-04-15T23:38:04.150860+0000","last_peered":"2024-04-15T23:38:04.150860+0000","last_clean":"2024-04-15T23:38:04.150860+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:04.150860+0000","last_undegraded":"2024-04-15T23:38:04.150860+0000","last_fullsized":"2024-04-15T23:38:04.150860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:36.179704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":516,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151233+0000","last_change":"2024-04-15T23:37:54.975373+0000","last_active":"2024-04-15T23:38:04.151233+0000","last_peered":"2024-04-15T23:38:04.151233+0000","last_clean":"2024-04-15T23:38:04.151233+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:04.151233+0000","last_undegraded":"2024-04-15T23:38:04.151233+0000","last_fullsized":"2024-04-15T23:38:04.151233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:44.503479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054482+0000","last_change":"2024-04-15T23:37:54.984078+0000","last_active":"2024-04-15T23:38:04.054482+0000","last_peered":"2024-04-15T23:38:04.054482+0000","last_clean":"2024-04-15T23:38:04.054482+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:04.054482+0000","last_undegraded":"2024-04-15T23:38:04.054482+0000","last_fullsized":"2024-04-15T23:38:04.054482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:04:28.242880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054340+0000","last_change":"2024-04-15T23:37:54.970987+0000","last_active":"2024-04-15T23:38:04.054340+0000","last_peered":"2024-04-15T23:38:04.054340+0000","last_clean":"2024-04-15T23:38:04.054340+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:04.054340+0000","last_undegraded":"2024-04-15T23:38:04.054340+0000","last_fullsized":"2024-04-15T23:38:04.054340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:54.676743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054295+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054295+0000","last_peered":"2024-04-15T23:38:04.054295+0000","last_clean":"2024-04-15T23:38:04.054295+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054295+0000","last_undegraded":"2024-04-15T23:38:04.054295+0000","last_fullsized":"2024-04-15T23:38:04.054295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055405+0000","last_change":"2024-04-15T23:37:54.980092+0000","last_active":"2024-04-15T23:38:04.055405+0000","last_peered":"2024-04-15T23:38:04.055405+0000","last_clean":"2024-04-15T23:38:04.055405+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:04.055405+0000","last_undegraded":"2024-04-15T23:38:04.055405+0000","last_fullsized":"2024-04-15T23:38:04.055405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:57.488763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055369+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055369+0000","last_peered":"2024-04-15T23:38:04.055369+0000","last_clean":"2024-04-15T23:38:04.055369+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055369+0000","last_undegraded":"2024-04-15T23:38:04.055369+0000","last_fullsized":"2024-04-15T23:38:04.055369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:15:42.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":267,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151158+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151158+0000","last_peered":"2024-04-15T23:38:04.151158+0000","last_clean":"2024-04-15T23:38:04.151158+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151158+0000","last_undegraded":"2024-04-15T23:38:04.151158+0000","last_fullsized":"2024-04-15T23:38:04.151158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:08.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055032+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055032+0000","last_peered":"2024-04-15T23:38:04.055032+0000","last_clean":"2024-04-15T23:38:04.055032+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055032+0000","last_undegraded":"2024-04-15T23:38:04.055032+0000","last_fullsized":"2024-04-15T23:38:04.055032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:56.957050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054430+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:38:04.054430+0000","last_peered":"2024-04-15T23:38:04.054430+0000","last_clean":"2024-04-15T23:38:04.054430+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:04.054430+0000","last_undegraded":"2024-04-15T23:38:04.054430+0000","last_fullsized":"2024-04-15T23:38:04.054430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054605+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054605+0000","last_peered":"2024-04-15T23:38:04.054605+0000","last_clean":"2024-04-15T23:38:04.054605+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054605+0000","last_undegraded":"2024-04-15T23:38:04.054605+0000","last_fullsized":"2024-04-15T23:38:04.054605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:42:47.190183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054713+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054713+0000","last_peered":"2024-04-15T23:38:04.054713+0000","last_clean":"2024-04-15T23:38:04.054713+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054713+0000","last_undegraded":"2024-04-15T23:38:04.054713+0000","last_fullsized":"2024-04-15T23:38:04.054713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150050+0000","last_change":"2024-04-15T23:37:54.979663+0000","last_active":"2024-04-15T23:38:04.150050+0000","last_peered":"2024-04-15T23:38:04.150050+0000","last_clean":"2024-04-15T23:38:04.150050+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:04.150050+0000","last_undegraded":"2024-04-15T23:38:04.150050+0000","last_fullsized":"2024-04-15T23:38:04.150050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:16:39.846762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150353+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150353+0000","last_peered":"2024-04-15T23:38:04.150353+0000","last_clean":"2024-04-15T23:38:04.150353+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150353+0000","last_undegraded":"2024-04-15T23:38:04.150353+0000","last_fullsized":"2024-04-15T23:38:04.150353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:45:18.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055118+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055118+0000","last_peered":"2024-04-15T23:38:04.055118+0000","last_clean":"2024-04-15T23:38:04.055118+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055118+0000","last_undegraded":"2024-04-15T23:38:04.055118+0000","last_fullsized":"2024-04-15T23:38:04.055118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054459+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054459+0000","last_peered":"2024-04-15T23:38:04.054459+0000","last_clean":"2024-04-15T23:38:04.054459+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054459+0000","last_undegraded":"2024-04-15T23:38:04.054459+0000","last_fullsized":"2024-04-15T23:38:04.054459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:48.663512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":309,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.970465+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:21.553276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054650+0000","last_change":"2024-04-15T23:37:54.975024+0000","last_active":"2024-04-15T23:38:04.054650+0000","last_peered":"2024-04-15T23:38:04.054650+0000","last_clean":"2024-04-15T23:38:04.054650+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:04.054650+0000","last_undegraded":"2024-04-15T23:38:04.054650+0000","last_fullsized":"2024-04-15T23:38:04.054650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:07:57.085578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055211+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055211+0000","last_peered":"2024-04-15T23:38:04.055211+0000","last_clean":"2024-04-15T23:38:04.055211+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055211+0000","last_undegraded":"2024-04-15T23:38:04.055211+0000","last_fullsized":"2024-04-15T23:38:04.055211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:45.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150030+0000","last_change":"2024-04-15T23:37:54.980128+0000","last_active":"2024-04-15T23:38:04.150030+0000","last_peered":"2024-04-15T23:38:04.150030+0000","last_clean":"2024-04-15T23:38:04.150030+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:04.150030+0000","last_undegraded":"2024-04-15T23:38:04.150030+0000","last_fullsized":"2024-04-15T23:38:04.150030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:26:41.575192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151238+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151238+0000","last_peered":"2024-04-15T23:38:04.151238+0000","last_clean":"2024-04-15T23:38:04.151238+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151238+0000","last_undegraded":"2024-04-15T23:38:04.151238+0000","last_fullsized":"2024-04-15T23:38:04.151238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:43.826554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":303,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054304+0000","last_change":"2024-04-15T23:37:54.980087+0000","last_active":"2024-04-15T23:38:04.054304+0000","last_peered":"2024-04-15T23:38:04.054304+0000","last_clean":"2024-04-15T23:38:04.054304+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:04.054304+0000","last_undegraded":"2024-04-15T23:38:04.054304+0000","last_fullsized":"2024-04-15T23:38:04.054304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:40:49.638064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055338+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:04.055338+0000","last_peered":"2024-04-15T23:38:04.055338+0000","last_clean":"2024-04-15T23:38:04.055338+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:04.055338+0000","last_undegraded":"2024-04-15T23:38:04.055338+0000","last_fullsized":"2024-04-15T23:38:04.055338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:57.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":566,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054387+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054387+0000","last_peered":"2024-04-15T23:38:04.054387+0000","last_clean":"2024-04-15T23:38:04.054387+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054387+0000","last_undegraded":"2024-04-15T23:38:04.054387+0000","last_fullsized":"2024-04-15T23:38:04.054387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150879+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.150879+0000","last_peered":"2024-04-15T23:38:04.150879+0000","last_clean":"2024-04-15T23:38:04.150879+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.150879+0000","last_undegraded":"2024-04-15T23:38:04.150879+0000","last_fullsized":"2024-04-15T23:38:04.150879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:38:27.066961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151007+0000","last_change":"2024-04-15T23:37:54.975622+0000","last_active":"2024-04-15T23:38:04.151007+0000","last_peered":"2024-04-15T23:38:04.151007+0000","last_clean":"2024-04-15T23:38:04.151007+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:04.151007+0000","last_undegraded":"2024-04-15T23:38:04.151007+0000","last_fullsized":"2024-04-15T23:38:04.151007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:17:12.523528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150683+0000","last_change":"2024-04-15T23:37:54.974738+0000","last_active":"2024-04-15T23:38:04.150683+0000","last_peered":"2024-04-15T23:38:04.150683+0000","last_clean":"2024-04-15T23:38:04.150683+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:04.150683+0000","last_undegraded":"2024-04-15T23:38:04.150683+0000","last_fullsized":"2024-04-15T23:38:04.150683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:41:17.825004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055234+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055234+0000","last_peered":"2024-04-15T23:38:04.055234+0000","last_clean":"2024-04-15T23:38:04.055234+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055234+0000","last_undegraded":"2024-04-15T23:38:04.055234+0000","last_fullsized":"2024-04-15T23:38:04.055234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:50:08.878782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054981+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.054981+0000","last_peered":"2024-04-15T23:38:04.054981+0000","last_clean":"2024-04-15T23:38:04.054981+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.054981+0000","last_undegraded":"2024-04-15T23:38:04.054981+0000","last_fullsized":"2024-04-15T23:38:04.054981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:46:16.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150966+0000","last_change":"2024-04-15T23:37:54.975504+0000","last_active":"2024-04-15T23:38:04.150966+0000","last_peered":"2024-04-15T23:38:04.150966+0000","last_clean":"2024-04-15T23:38:04.150966+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:04.150966+0000","last_undegraded":"2024-04-15T23:38:04.150966+0000","last_fullsized":"2024-04-15T23:38:04.150966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:54:46.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150389+0000","last_change":"2024-04-15T23:37:54.974969+0000","last_active":"2024-04-15T23:38:04.150389+0000","last_peered":"2024-04-15T23:38:04.150389+0000","last_clean":"2024-04-15T23:38:04.150389+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:04.150389+0000","last_undegraded":"2024-04-15T23:38:04.150389+0000","last_fullsized":"2024-04-15T23:38:04.150389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:24.991458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150768+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150768+0000","last_peered":"2024-04-15T23:38:04.150768+0000","last_clean":"2024-04-15T23:38:04.150768+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150768+0000","last_undegraded":"2024-04-15T23:38:04.150768+0000","last_fullsized":"2024-04-15T23:38:04.150768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:45:24.736666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054719+0000","last_change":"2024-04-15T23:37:54.975484+0000","last_active":"2024-04-15T23:38:04.054719+0000","last_peered":"2024-04-15T23:38:04.054719+0000","last_clean":"2024-04-15T23:38:04.054719+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:04.054719+0000","last_undegraded":"2024-04-15T23:38:04.054719+0000","last_fullsized":"2024-04-15T23:38:04.054719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:35.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151067+0000","last_change":"2024-04-15T23:37:54.979558+0000","last_active":"2024-04-15T23:38:04.151067+0000","last_peered":"2024-04-15T23:38:04.151067+0000","last_clean":"2024-04-15T23:38:04.151067+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:04.151067+0000","last_undegraded":"2024-04-15T23:38:04.151067+0000","last_fullsized":"2024-04-15T23:38:04.151067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:34:18.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054445+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054445+0000","last_peered":"2024-04-15T23:38:04.054445+0000","last_clean":"2024-04-15T23:38:04.054445+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054445+0000","last_undegraded":"2024-04-15T23:38:04.054445+0000","last_fullsized":"2024-04-15T23:38:04.054445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055602+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:38:04.055602+0000","last_peered":"2024-04-15T23:38:04.055602+0000","last_clean":"2024-04-15T23:38:04.055602+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:04.055602+0000","last_undegraded":"2024-04-15T23:38:04.055602+0000","last_fullsized":"2024-04-15T23:38:04.055602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.149931+0000","last_change":"2024-04-15T23:37:54.980406+0000","last_active":"2024-04-15T23:38:04.149931+0000","last_peered":"2024-04-15T23:38:04.149931+0000","last_clean":"2024-04-15T23:38:04.149931+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:04.149931+0000","last_undegraded":"2024-04-15T23:38:04.149931+0000","last_fullsized":"2024-04-15T23:38:04.149931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:06.260508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150220+0000","last_change":"2024-04-15T23:37:54.975952+0000","last_active":"2024-04-15T23:38:04.150220+0000","last_peered":"2024-04-15T23:38:04.150220+0000","last_clean":"2024-04-15T23:38:04.150220+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:04.150220+0000","last_undegraded":"2024-04-15T23:38:04.150220+0000","last_fullsized":"2024-04-15T23:38:04.150220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:11.183075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054759+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054759+0000","last_peered":"2024-04-15T23:38:04.054759+0000","last_clean":"2024-04-15T23:38:04.054759+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054759+0000","last_undegraded":"2024-04-15T23:38:04.054759+0000","last_fullsized":"2024-04-15T23:38:04.054759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151039+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151039+0000","last_peered":"2024-04-15T23:38:04.151039+0000","last_clean":"2024-04-15T23:38:04.151039+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151039+0000","last_undegraded":"2024-04-15T23:38:04.151039+0000","last_fullsized":"2024-04-15T23:38:04.151039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:20:33.862210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150243+0000","last_change":"2024-04-15T23:37:54.980322+0000","last_active":"2024-04-15T23:38:04.150243+0000","last_peered":"2024-04-15T23:38:04.150243+0000","last_clean":"2024-04-15T23:38:04.150243+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:04.150243+0000","last_undegraded":"2024-04-15T23:38:04.150243+0000","last_fullsized":"2024-04-15T23:38:04.150243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:04:30.063643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054307+0000","last_change":"2024-04-15T23:37:54.969392+0000","last_active":"2024-04-15T23:38:04.054307+0000","last_peered":"2024-04-15T23:38:04.054307+0000","last_clean":"2024-04-15T23:38:04.054307+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:04.054307+0000","last_undegraded":"2024-04-15T23:38:04.054307+0000","last_fullsized":"2024-04-15T23:38:04.054307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:34.602096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055197+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:38:04.055197+0000","last_peered":"2024-04-15T23:38:04.055197+0000","last_clean":"2024-04-15T23:38:04.055197+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:04.055197+0000","last_undegraded":"2024-04-15T23:38:04.055197+0000","last_fullsized":"2024-04-15T23:38:04.055197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054520+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054520+0000","last_peered":"2024-04-15T23:38:04.054520+0000","last_clean":"2024-04-15T23:38:04.054520+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054520+0000","last_undegraded":"2024-04-15T23:38:04.054520+0000","last_fullsized":"2024-04-15T23:38:04.054520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":208,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054569+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.054569+0000","last_peered":"2024-04-15T23:38:04.054569+0000","last_clean":"2024-04-15T23:38:04.054569+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:04.054569+0000","last_undegraded":"2024-04-15T23:38:04.054569+0000","last_fullsized":"2024-04-15T23:38:04.054569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:00:37.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055575+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:38:04.055575+0000","last_peered":"2024-04-15T23:38:04.055575+0000","last_clean":"2024-04-15T23:38:04.055575+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:04.055575+0000","last_undegraded":"2024-04-15T23:38:04.055575+0000","last_fullsized":"2024-04-15T23:38:04.055575+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150089+0000","last_change":"2024-04-15T23:37:54.974977+0000","last_active":"2024-04-15T23:38:04.150089+0000","last_peered":"2024-04-15T23:38:04.150089+0000","last_clean":"2024-04-15T23:38:04.150089+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:04.150089+0000","last_undegraded":"2024-04-15T23:38:04.150089+0000","last_fullsized":"2024-04-15T23:38:04.150089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:17:35.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150304+0000","last_change":"2024-04-15T23:37:54.976495+0000","last_active":"2024-04-15T23:38:04.150304+0000","last_peered":"2024-04-15T23:38:04.150304+0000","last_clean":"2024-04-15T23:38:04.150304+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:04.150304+0000","last_undegraded":"2024-04-15T23:38:04.150304+0000","last_fullsized":"2024-04-15T23:38:04.150304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:22:39.677169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054628+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:38:04.054628+0000","last_peered":"2024-04-15T23:38:04.054628+0000","last_clean":"2024-04-15T23:38:04.054628+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:04.054628+0000","last_undegraded":"2024-04-15T23:38:04.054628+0000","last_fullsized":"2024-04-15T23:38:04.054628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150576+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150576+0000","last_peered":"2024-04-15T23:38:04.150576+0000","last_clean":"2024-04-15T23:38:04.150576+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150576+0000","last_undegraded":"2024-04-15T23:38:04.150576+0000","last_fullsized":"2024-04-15T23:38:04.150576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:04:50.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054602+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054602+0000","last_peered":"2024-04-15T23:38:04.054602+0000","last_clean":"2024-04-15T23:38:04.054602+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054602+0000","last_undegraded":"2024-04-15T23:38:04.054602+0000","last_fullsized":"2024-04-15T23:38:04.054602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":361,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054539+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054539+0000","last_peered":"2024-04-15T23:38:04.054539+0000","last_clean":"2024-04-15T23:38:04.054539+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054539+0000","last_undegraded":"2024-04-15T23:38:04.054539+0000","last_fullsized":"2024-04-15T23:38:04.054539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:22.640720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055329+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:38:04.055329+0000","last_peered":"2024-04-15T23:38:04.055329+0000","last_clean":"2024-04-15T23:38:04.055329+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:04.055329+0000","last_undegraded":"2024-04-15T23:38:04.055329+0000","last_fullsized":"2024-04-15T23:38:04.055329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:37:54.980855+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:03.374439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055280+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055280+0000","last_peered":"2024-04-15T23:38:04.055280+0000","last_clean":"2024-04-15T23:38:04.055280+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055280+0000","last_undegraded":"2024-04-15T23:38:04.055280+0000","last_fullsized":"2024-04-15T23:38:04.055280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055018+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055018+0000","last_peered":"2024-04-15T23:38:04.055018+0000","last_clean":"2024-04-15T23:38:04.055018+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055018+0000","last_undegraded":"2024-04-15T23:38:04.055018+0000","last_fullsized":"2024-04-15T23:38:04.055018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055007+0000","last_change":"2024-04-15T23:37:54.969099+0000","last_active":"2024-04-15T23:38:04.055007+0000","last_peered":"2024-04-15T23:38:04.055007+0000","last_clean":"2024-04-15T23:38:04.055007+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:04.055007+0000","last_undegraded":"2024-04-15T23:38:04.055007+0000","last_fullsized":"2024-04-15T23:38:04.055007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:33:24.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150996+0000","last_change":"2024-04-15T23:37:54.977549+0000","last_active":"2024-04-15T23:38:04.150996+0000","last_peered":"2024-04-15T23:38:04.150996+0000","last_clean":"2024-04-15T23:38:04.150996+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:04.150996+0000","last_undegraded":"2024-04-15T23:38:04.150996+0000","last_fullsized":"2024-04-15T23:38:04.150996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:20:29.898627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054388+0000","last_change":"2024-04-15T23:37:54.983847+0000","last_active":"2024-04-15T23:38:04.054388+0000","last_peered":"2024-04-15T23:38:04.054388+0000","last_clean":"2024-04-15T23:38:04.054388+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:04.054388+0000","last_undegraded":"2024-04-15T23:38:04.054388+0000","last_fullsized":"2024-04-15T23:38:04.054388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:08:01.568734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150777+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150777+0000","last_peered":"2024-04-15T23:38:04.150777+0000","last_clean":"2024-04-15T23:38:04.150777+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150777+0000","last_undegraded":"2024-04-15T23:38:04.150777+0000","last_fullsized":"2024-04-15T23:38:04.150777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:56.623760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150376+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150376+0000","last_peered":"2024-04-15T23:38:04.150376+0000","last_clean":"2024-04-15T23:38:04.150376+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150376+0000","last_undegraded":"2024-04-15T23:38:04.150376+0000","last_fullsized":"2024-04-15T23:38:04.150376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:57:32.784527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":174,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:54:03.314247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150917+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150917+0000","last_peered":"2024-04-15T23:38:04.150917+0000","last_clean":"2024-04-15T23:38:04.150917+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150917+0000","last_undegraded":"2024-04-15T23:38:04.150917+0000","last_fullsized":"2024-04-15T23:38:04.150917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:42.892541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054473+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054473+0000","last_peered":"2024-04-15T23:38:04.054473+0000","last_clean":"2024-04-15T23:38:04.054473+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054473+0000","last_undegraded":"2024-04-15T23:38:04.054473+0000","last_fullsized":"2024-04-15T23:38:04.054473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:20:23.720332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055487+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.055487+0000","last_peered":"2024-04-15T23:38:04.055487+0000","last_clean":"2024-04-15T23:38:04.055487+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:04.055487+0000","last_undegraded":"2024-04-15T23:38:04.055487+0000","last_fullsized":"2024-04-15T23:38:04.055487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:11:04.686698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054313+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:38:04.054313+0000","last_peered":"2024-04-15T23:38:04.054313+0000","last_clean":"2024-04-15T23:38:04.054313+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:04.054313+0000","last_undegraded":"2024-04-15T23:38:04.054313+0000","last_fullsized":"2024-04-15T23:38:04.054313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055521+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055521+0000","last_peered":"2024-04-15T23:38:04.055521+0000","last_clean":"2024-04-15T23:38:04.055521+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055521+0000","last_undegraded":"2024-04-15T23:38:04.055521+0000","last_fullsized":"2024-04-15T23:38:04.055521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:37:38.502349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054157+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054157+0000","last_peered":"2024-04-15T23:38:04.054157+0000","last_clean":"2024-04-15T23:38:04.054157+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054157+0000","last_undegraded":"2024-04-15T23:38:04.054157+0000","last_fullsized":"2024-04-15T23:38:04.054157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":272,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:09.331923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054226+0000","last_change":"2024-04-15T23:37:54.969689+0000","last_active":"2024-04-15T23:38:04.054226+0000","last_peered":"2024-04-15T23:38:04.054226+0000","last_clean":"2024-04-15T23:38:04.054226+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:04.054226+0000","last_undegraded":"2024-04-15T23:38:04.054226+0000","last_fullsized":"2024-04-15T23:38:04.054226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:16:27.272034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054836+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054836+0000","last_peered":"2024-04-15T23:38:04.054836+0000","last_clean":"2024-04-15T23:38:04.054836+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054836+0000","last_undegraded":"2024-04-15T23:38:04.054836+0000","last_fullsized":"2024-04-15T23:38:04.054836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:37:11.947230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054669+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054669+0000","last_peered":"2024-04-15T23:38:04.054669+0000","last_clean":"2024-04-15T23:38:04.054669+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054669+0000","last_undegraded":"2024-04-15T23:38:04.054669+0000","last_fullsized":"2024-04-15T23:38:04.054669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054921+0000","last_change":"2024-04-15T23:37:54.983724+0000","last_active":"2024-04-15T23:38:04.054921+0000","last_peered":"2024-04-15T23:38:04.054921+0000","last_clean":"2024-04-15T23:38:04.054921+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:04.054921+0000","last_undegraded":"2024-04-15T23:38:04.054921+0000","last_fullsized":"2024-04-15T23:38:04.054921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:09.088379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":517,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150652+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150652+0000","last_peered":"2024-04-15T23:38:04.150652+0000","last_clean":"2024-04-15T23:38:04.150652+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150652+0000","last_undegraded":"2024-04-15T23:38:04.150652+0000","last_fullsized":"2024-04-15T23:38:04.150652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:01:49.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150486+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150486+0000","last_peered":"2024-04-15T23:38:04.150486+0000","last_clean":"2024-04-15T23:38:04.150486+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150486+0000","last_undegraded":"2024-04-15T23:38:04.150486+0000","last_fullsized":"2024-04-15T23:38:04.150486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:12.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150392+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150392+0000","last_peered":"2024-04-15T23:38:04.150392+0000","last_clean":"2024-04-15T23:38:04.150392+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150392+0000","last_undegraded":"2024-04-15T23:38:04.150392+0000","last_fullsized":"2024-04-15T23:38:04.150392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:10.597065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":210,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055160+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055160+0000","last_peered":"2024-04-15T23:38:04.055160+0000","last_clean":"2024-04-15T23:38:04.055160+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055160+0000","last_undegraded":"2024-04-15T23:38:04.055160+0000","last_fullsized":"2024-04-15T23:38:04.055160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:42.810034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054783+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054783+0000","last_peered":"2024-04-15T23:38:04.054783+0000","last_clean":"2024-04-15T23:38:04.054783+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054783+0000","last_undegraded":"2024-04-15T23:38:04.054783+0000","last_fullsized":"2024-04-15T23:38:04.054783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055412+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055412+0000","last_peered":"2024-04-15T23:38:04.055412+0000","last_clean":"2024-04-15T23:38:04.055412+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055412+0000","last_undegraded":"2024-04-15T23:38:04.055412+0000","last_fullsized":"2024-04-15T23:38:04.055412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":577,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150501+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150501+0000","last_peered":"2024-04-15T23:38:04.150501+0000","last_clean":"2024-04-15T23:38:04.150501+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150501+0000","last_undegraded":"2024-04-15T23:38:04.150501+0000","last_fullsized":"2024-04-15T23:38:04.150501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:42:50.642806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055152+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055152+0000","last_peered":"2024-04-15T23:38:04.055152+0000","last_clean":"2024-04-15T23:38:04.055152+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055152+0000","last_undegraded":"2024-04-15T23:38:04.055152+0000","last_fullsized":"2024-04-15T23:38:04.055152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:35:47.730630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103205,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85412,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286428,"statfs":{"total":96636764160,"available":96549302272,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80980,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290860,"statfs":{"total":96636764160,"available":96553840640,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88936,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282904,"statfs":{"total":96636764160,"available":96545693696,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:06.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:07.184 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:07.185 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:07.195 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-15T23:38:05.881474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255328,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860192,"statfs":{"total":289910292480,"available":289648836608,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.846081"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055400+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:38:04.055400+0000","last_peered":"2024-04-15T23:38:04.055400+0000","last_clean":"2024-04-15T23:38:04.055400+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:04.055400+0000","last_undegraded":"2024-04-15T23:38:04.055400+0000","last_fullsized":"2024-04-15T23:38:04.055400+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055039+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:38:04.055039+0000","last_peered":"2024-04-15T23:38:04.055039+0000","last_clean":"2024-04-15T23:38:04.055039+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:04.055039+0000","last_undegraded":"2024-04-15T23:38:04.055039+0000","last_fullsized":"2024-04-15T23:38:04.055039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151265+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151265+0000","last_peered":"2024-04-15T23:38:04.151265+0000","last_clean":"2024-04-15T23:38:04.151265+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151265+0000","last_undegraded":"2024-04-15T23:38:04.151265+0000","last_fullsized":"2024-04-15T23:38:04.151265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:18:46.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":446,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150655+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150655+0000","last_peered":"2024-04-15T23:38:04.150655+0000","last_clean":"2024-04-15T23:38:04.150655+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150655+0000","last_undegraded":"2024-04-15T23:38:04.150655+0000","last_fullsized":"2024-04-15T23:38:04.150655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:06:46.388157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150937+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.150937+0000","last_peered":"2024-04-15T23:38:04.150937+0000","last_clean":"2024-04-15T23:38:04.150937+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.150937+0000","last_undegraded":"2024-04-15T23:38:04.150937+0000","last_fullsized":"2024-04-15T23:38:04.150937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:49:46.849666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:57.967361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":461,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150156+0000","last_change":"2024-04-15T23:37:54.979553+0000","last_active":"2024-04-15T23:38:04.150156+0000","last_peered":"2024-04-15T23:38:04.150156+0000","last_clean":"2024-04-15T23:38:04.150156+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:04.150156+0000","last_undegraded":"2024-04-15T23:38:04.150156+0000","last_fullsized":"2024-04-15T23:38:04.150156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:10:07.716446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055404+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:38:04.055404+0000","last_peered":"2024-04-15T23:38:04.055404+0000","last_clean":"2024-04-15T23:38:04.055404+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:04.055404+0000","last_undegraded":"2024-04-15T23:38:04.055404+0000","last_fullsized":"2024-04-15T23:38:04.055404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055091+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:38:04.055091+0000","last_peered":"2024-04-15T23:38:04.055091+0000","last_clean":"2024-04-15T23:38:04.055091+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:04.055091+0000","last_undegraded":"2024-04-15T23:38:04.055091+0000","last_fullsized":"2024-04-15T23:38:04.055091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":495,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151157+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151157+0000","last_peered":"2024-04-15T23:38:04.151157+0000","last_clean":"2024-04-15T23:38:04.151157+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151157+0000","last_undegraded":"2024-04-15T23:38:04.151157+0000","last_fullsized":"2024-04-15T23:38:04.151157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:44.888221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:37:54.980913+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:05.402863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":462,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054625+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:38:04.054625+0000","last_peered":"2024-04-15T23:38:04.054625+0000","last_clean":"2024-04-15T23:38:04.054625+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:04.054625+0000","last_undegraded":"2024-04-15T23:38:04.054625+0000","last_fullsized":"2024-04-15T23:38:04.054625+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":288,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150828+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150828+0000","last_peered":"2024-04-15T23:38:04.150828+0000","last_clean":"2024-04-15T23:38:04.150828+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150828+0000","last_undegraded":"2024-04-15T23:38:04.150828+0000","last_fullsized":"2024-04-15T23:38:04.150828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:13:18.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150330+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150330+0000","last_peered":"2024-04-15T23:38:04.150330+0000","last_clean":"2024-04-15T23:38:04.150330+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150330+0000","last_undegraded":"2024-04-15T23:38:04.150330+0000","last_fullsized":"2024-04-15T23:38:04.150330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:29:51.531478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":547,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150536+0000","last_change":"2024-04-15T23:37:54.977342+0000","last_active":"2024-04-15T23:38:04.150536+0000","last_peered":"2024-04-15T23:38:04.150536+0000","last_clean":"2024-04-15T23:38:04.150536+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:04.150536+0000","last_undegraded":"2024-04-15T23:38:04.150536+0000","last_fullsized":"2024-04-15T23:38:04.150536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:08:13.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055354+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:38:04.055354+0000","last_peered":"2024-04-15T23:38:04.055354+0000","last_clean":"2024-04-15T23:38:04.055354+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:04.055354+0000","last_undegraded":"2024-04-15T23:38:04.055354+0000","last_fullsized":"2024-04-15T23:38:04.055354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055324+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:38:04.055324+0000","last_peered":"2024-04-15T23:38:04.055324+0000","last_clean":"2024-04-15T23:38:04.055324+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:04.055324+0000","last_undegraded":"2024-04-15T23:38:04.055324+0000","last_fullsized":"2024-04-15T23:38:04.055324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":252,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054942+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:38:04.054942+0000","last_peered":"2024-04-15T23:38:04.054942+0000","last_clean":"2024-04-15T23:38:04.054942+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:04.054942+0000","last_undegraded":"2024-04-15T23:38:04.054942+0000","last_fullsized":"2024-04-15T23:38:04.054942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150860+0000","last_change":"2024-04-15T23:37:54.974826+0000","last_active":"2024-04-15T23:38:04.150860+0000","last_peered":"2024-04-15T23:38:04.150860+0000","last_clean":"2024-04-15T23:38:04.150860+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:04.150860+0000","last_undegraded":"2024-04-15T23:38:04.150860+0000","last_fullsized":"2024-04-15T23:38:04.150860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:36.179704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":516,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151233+0000","last_change":"2024-04-15T23:37:54.975373+0000","last_active":"2024-04-15T23:38:04.151233+0000","last_peered":"2024-04-15T23:38:04.151233+0000","last_clean":"2024-04-15T23:38:04.151233+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:04.151233+0000","last_undegraded":"2024-04-15T23:38:04.151233+0000","last_fullsized":"2024-04-15T23:38:04.151233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:44.503479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054482+0000","last_change":"2024-04-15T23:37:54.984078+0000","last_active":"2024-04-15T23:38:04.054482+0000","last_peered":"2024-04-15T23:38:04.054482+0000","last_clean":"2024-04-15T23:38:04.054482+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:04.054482+0000","last_undegraded":"2024-04-15T23:38:04.054482+0000","last_fullsized":"2024-04-15T23:38:04.054482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:04:28.242880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054340+0000","last_change":"2024-04-15T23:37:54.970987+0000","last_active":"2024-04-15T23:38:04.054340+0000","last_peered":"2024-04-15T23:38:04.054340+0000","last_clean":"2024-04-15T23:38:04.054340+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:04.054340+0000","last_undegraded":"2024-04-15T23:38:04.054340+0000","last_fullsized":"2024-04-15T23:38:04.054340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:54.676743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054295+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054295+0000","last_peered":"2024-04-15T23:38:04.054295+0000","last_clean":"2024-04-15T23:38:04.054295+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054295+0000","last_undegraded":"2024-04-15T23:38:04.054295+0000","last_fullsized":"2024-04-15T23:38:04.054295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055405+0000","last_change":"2024-04-15T23:37:54.980092+0000","last_active":"2024-04-15T23:38:04.055405+0000","last_peered":"2024-04-15T23:38:04.055405+0000","last_clean":"2024-04-15T23:38:04.055405+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:04.055405+0000","last_undegraded":"2024-04-15T23:38:04.055405+0000","last_fullsized":"2024-04-15T23:38:04.055405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:57.488763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055369+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055369+0000","last_peered":"2024-04-15T23:38:04.055369+0000","last_clean":"2024-04-15T23:38:04.055369+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055369+0000","last_undegraded":"2024-04-15T23:38:04.055369+0000","last_fullsized":"2024-04-15T23:38:04.055369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:15:42.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":267,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151158+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151158+0000","last_peered":"2024-04-15T23:38:04.151158+0000","last_clean":"2024-04-15T23:38:04.151158+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151158+0000","last_undegraded":"2024-04-15T23:38:04.151158+0000","last_fullsized":"2024-04-15T23:38:04.151158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:08.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055032+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055032+0000","last_peered":"2024-04-15T23:38:04.055032+0000","last_clean":"2024-04-15T23:38:04.055032+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055032+0000","last_undegraded":"2024-04-15T23:38:04.055032+0000","last_fullsized":"2024-04-15T23:38:04.055032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:56.957050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054430+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:38:04.054430+0000","last_peered":"2024-04-15T23:38:04.054430+0000","last_clean":"2024-04-15T23:38:04.054430+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:04.054430+0000","last_undegraded":"2024-04-15T23:38:04.054430+0000","last_fullsized":"2024-04-15T23:38:04.054430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054605+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054605+0000","last_peered":"2024-04-15T23:38:04.054605+0000","last_clean":"2024-04-15T23:38:04.054605+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054605+0000","last_undegraded":"2024-04-15T23:38:04.054605+0000","last_fullsized":"2024-04-15T23:38:04.054605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:42:47.190183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054713+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054713+0000","last_peered":"2024-04-15T23:38:04.054713+0000","last_clean":"2024-04-15T23:38:04.054713+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054713+0000","last_undegraded":"2024-04-15T23:38:04.054713+0000","last_fullsized":"2024-04-15T23:38:04.054713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150050+0000","last_change":"2024-04-15T23:37:54.979663+0000","last_active":"2024-04-15T23:38:04.150050+0000","last_peered":"2024-04-15T23:38:04.150050+0000","last_clean":"2024-04-15T23:38:04.150050+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:04.150050+0000","last_undegraded":"2024-04-15T23:38:04.150050+0000","last_fullsized":"2024-04-15T23:38:04.150050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:16:39.846762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150353+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150353+0000","last_peered":"2024-04-15T23:38:04.150353+0000","last_clean":"2024-04-15T23:38:04.150353+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150353+0000","last_undegraded":"2024-04-15T23:38:04.150353+0000","last_fullsized":"2024-04-15T23:38:04.150353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:45:18.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055118+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055118+0000","last_peered":"2024-04-15T23:38:04.055118+0000","last_clean":"2024-04-15T23:38:04.055118+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055118+0000","last_undegraded":"2024-04-15T23:38:04.055118+0000","last_fullsized":"2024-04-15T23:38:04.055118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054459+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054459+0000","last_peered":"2024-04-15T23:38:04.054459+0000","last_clean":"2024-04-15T23:38:04.054459+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054459+0000","last_undegraded":"2024-04-15T23:38:04.054459+0000","last_fullsized":"2024-04-15T23:38:04.054459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:48.663512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":309,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.970465+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:21.553276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054650+0000","last_change":"2024-04-15T23:37:54.975024+0000","last_active":"2024-04-15T23:38:04.054650+0000","last_peered":"2024-04-15T23:38:04.054650+0000","last_clean":"2024-04-15T23:38:04.054650+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:04.054650+0000","last_undegraded":"2024-04-15T23:38:04.054650+0000","last_fullsized":"2024-04-15T23:38:04.054650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:07:57.085578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055211+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055211+0000","last_peered":"2024-04-15T23:38:04.055211+0000","last_clean":"2024-04-15T23:38:04.055211+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055211+0000","last_undegraded":"2024-04-15T23:38:04.055211+0000","last_fullsized":"2024-04-15T23:38:04.055211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:45.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150030+0000","last_change":"2024-04-15T23:37:54.980128+0000","last_active":"2024-04-15T23:38:04.150030+0000","last_peered":"2024-04-15T23:38:04.150030+0000","last_clean":"2024-04-15T23:38:04.150030+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:04.150030+0000","last_undegraded":"2024-04-15T23:38:04.150030+0000","last_fullsized":"2024-04-15T23:38:04.150030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:26:41.575192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151238+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151238+0000","last_peered":"2024-04-15T23:38:04.151238+0000","last_clean":"2024-04-15T23:38:04.151238+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151238+0000","last_undegraded":"2024-04-15T23:38:04.151238+0000","last_fullsized":"2024-04-15T23:38:04.151238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:43.826554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":303,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054304+0000","last_change":"2024-04-15T23:37:54.980087+0000","last_active":"2024-04-15T23:38:04.054304+0000","last_peered":"2024-04-15T23:38:04.054304+0000","last_clean":"2024-04-15T23:38:04.054304+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:04.054304+0000","last_undegraded":"2024-04-15T23:38:04.054304+0000","last_fullsized":"2024-04-15T23:38:04.054304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:40:49.638064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055338+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:04.055338+0000","last_peered":"2024-04-15T23:38:04.055338+0000","last_clean":"2024-04-15T23:38:04.055338+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:04.055338+0000","last_undegraded":"2024-04-15T23:38:04.055338+0000","last_fullsized":"2024-04-15T23:38:04.055338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:57.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":566,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054387+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054387+0000","last_peered":"2024-04-15T23:38:04.054387+0000","last_clean":"2024-04-15T23:38:04.054387+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054387+0000","last_undegraded":"2024-04-15T23:38:04.054387+0000","last_fullsized":"2024-04-15T23:38:04.054387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150879+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.150879+0000","last_peered":"2024-04-15T23:38:04.150879+0000","last_clean":"2024-04-15T23:38:04.150879+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.150879+0000","last_undegraded":"2024-04-15T23:38:04.150879+0000","last_fullsized":"2024-04-15T23:38:04.150879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:38:27.066961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151007+0000","last_change":"2024-04-15T23:37:54.975622+0000","last_active":"2024-04-15T23:38:04.151007+0000","last_peered":"2024-04-15T23:38:04.151007+0000","last_clean":"2024-04-15T23:38:04.151007+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:04.151007+0000","last_undegraded":"2024-04-15T23:38:04.151007+0000","last_fullsized":"2024-04-15T23:38:04.151007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:17:12.523528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150683+0000","last_change":"2024-04-15T23:37:54.974738+0000","last_active":"2024-04-15T23:38:04.150683+0000","last_peered":"2024-04-15T23:38:04.150683+0000","last_clean":"2024-04-15T23:38:04.150683+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:04.150683+0000","last_undegraded":"2024-04-15T23:38:04.150683+0000","last_fullsized":"2024-04-15T23:38:04.150683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:41:17.825004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055234+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055234+0000","last_peered":"2024-04-15T23:38:04.055234+0000","last_clean":"2024-04-15T23:38:04.055234+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055234+0000","last_undegraded":"2024-04-15T23:38:04.055234+0000","last_fullsized":"2024-04-15T23:38:04.055234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:50:08.878782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054981+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.054981+0000","last_peered":"2024-04-15T23:38:04.054981+0000","last_clean":"2024-04-15T23:38:04.054981+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.054981+0000","last_undegraded":"2024-04-15T23:38:04.054981+0000","last_fullsized":"2024-04-15T23:38:04.054981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:46:16.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150966+0000","last_change":"2024-04-15T23:37:54.975504+0000","last_active":"2024-04-15T23:38:04.150966+0000","last_peered":"2024-04-15T23:38:04.150966+0000","last_clean":"2024-04-15T23:38:04.150966+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:04.150966+0000","last_undegraded":"2024-04-15T23:38:04.150966+0000","last_fullsized":"2024-04-15T23:38:04.150966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:54:46.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150389+0000","last_change":"2024-04-15T23:37:54.974969+0000","last_active":"2024-04-15T23:38:04.150389+0000","last_peered":"2024-04-15T23:38:04.150389+0000","last_clean":"2024-04-15T23:38:04.150389+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:04.150389+0000","last_undegraded":"2024-04-15T23:38:04.150389+0000","last_fullsized":"2024-04-15T23:38:04.150389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:24.991458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150768+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150768+0000","last_peered":"2024-04-15T23:38:04.150768+0000","last_clean":"2024-04-15T23:38:04.150768+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150768+0000","last_undegraded":"2024-04-15T23:38:04.150768+0000","last_fullsized":"2024-04-15T23:38:04.150768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:45:24.736666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054719+0000","last_change":"2024-04-15T23:37:54.975484+0000","last_active":"2024-04-15T23:38:04.054719+0000","last_peered":"2024-04-15T23:38:04.054719+0000","last_clean":"2024-04-15T23:38:04.054719+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:04.054719+0000","last_undegraded":"2024-04-15T23:38:04.054719+0000","last_fullsized":"2024-04-15T23:38:04.054719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:35.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151067+0000","last_change":"2024-04-15T23:37:54.979558+0000","last_active":"2024-04-15T23:38:04.151067+0000","last_peered":"2024-04-15T23:38:04.151067+0000","last_clean":"2024-04-15T23:38:04.151067+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:04.151067+0000","last_undegraded":"2024-04-15T23:38:04.151067+0000","last_fullsized":"2024-04-15T23:38:04.151067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:34:18.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054445+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054445+0000","last_peered":"2024-04-15T23:38:04.054445+0000","last_clean":"2024-04-15T23:38:04.054445+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054445+0000","last_undegraded":"2024-04-15T23:38:04.054445+0000","last_fullsized":"2024-04-15T23:38:04.054445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055602+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:38:04.055602+0000","last_peered":"2024-04-15T23:38:04.055602+0000","last_clean":"2024-04-15T23:38:04.055602+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:04.055602+0000","last_undegraded":"2024-04-15T23:38:04.055602+0000","last_fullsized":"2024-04-15T23:38:04.055602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.149931+0000","last_change":"2024-04-15T23:37:54.980406+0000","last_active":"2024-04-15T23:38:04.149931+0000","last_peered":"2024-04-15T23:38:04.149931+0000","last_clean":"2024-04-15T23:38:04.149931+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:04.149931+0000","last_undegraded":"2024-04-15T23:38:04.149931+0000","last_fullsized":"2024-04-15T23:38:04.149931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:06.260508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150220+0000","last_change":"2024-04-15T23:37:54.975952+0000","last_active":"2024-04-15T23:38:04.150220+0000","last_peered":"2024-04-15T23:38:04.150220+0000","last_clean":"2024-04-15T23:38:04.150220+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:04.150220+0000","last_undegraded":"2024-04-15T23:38:04.150220+0000","last_fullsized":"2024-04-15T23:38:04.150220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:11.183075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054759+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054759+0000","last_peered":"2024-04-15T23:38:04.054759+0000","last_clean":"2024-04-15T23:38:04.054759+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054759+0000","last_undegraded":"2024-04-15T23:38:04.054759+0000","last_fullsized":"2024-04-15T23:38:04.054759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151039+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151039+0000","last_peered":"2024-04-15T23:38:04.151039+0000","last_clean":"2024-04-15T23:38:04.151039+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151039+0000","last_undegraded":"2024-04-15T23:38:04.151039+0000","last_fullsized":"2024-04-15T23:38:04.151039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:20:33.862210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150243+0000","last_change":"2024-04-15T23:37:54.980322+0000","last_active":"2024-04-15T23:38:04.150243+0000","last_peered":"2024-04-15T23:38:04.150243+0000","last_clean":"2024-04-15T23:38:04.150243+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:04.150243+0000","last_undegraded":"2024-04-15T23:38:04.150243+0000","last_fullsized":"2024-04-15T23:38:04.150243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:04:30.063643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054307+0000","last_change":"2024-04-15T23:37:54.969392+0000","last_active":"2024-04-15T23:38:04.054307+0000","last_peered":"2024-04-15T23:38:04.054307+0000","last_clean":"2024-04-15T23:38:04.054307+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:04.054307+0000","last_undegraded":"2024-04-15T23:38:04.054307+0000","last_fullsized":"2024-04-15T23:38:04.054307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:34.602096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055197+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:38:04.055197+0000","last_peered":"2024-04-15T23:38:04.055197+0000","last_clean":"2024-04-15T23:38:04.055197+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:04.055197+0000","last_undegraded":"2024-04-15T23:38:04.055197+0000","last_fullsized":"2024-04-15T23:38:04.055197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054520+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054520+0000","last_peered":"2024-04-15T23:38:04.054520+0000","last_clean":"2024-04-15T23:38:04.054520+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054520+0000","last_undegraded":"2024-04-15T23:38:04.054520+0000","last_fullsized":"2024-04-15T23:38:04.054520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":208,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054569+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.054569+0000","last_peered":"2024-04-15T23:38:04.054569+0000","last_clean":"2024-04-15T23:38:04.054569+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:04.054569+0000","last_undegraded":"2024-04-15T23:38:04.054569+0000","last_fullsized":"2024-04-15T23:38:04.054569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:00:37.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055575+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:38:04.055575+0000","last_peered":"2024-04-15T23:38:04.055575+0000","last_clean":"2024-04-15T23:38:04.055575+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:04.055575+0000","last_undegraded":"2024-04-15T23:38:04.055575+0000","last_fullsized":"2024-04-15T23:38:04.055575+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150089+0000","last_change":"2024-04-15T23:37:54.974977+0000","last_active":"2024-04-15T23:38:04.150089+0000","last_peered":"2024-04-15T23:38:04.150089+0000","last_clean":"2024-04-15T23:38:04.150089+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:04.150089+0000","last_undegraded":"2024-04-15T23:38:04.150089+0000","last_fullsized":"2024-04-15T23:38:04.150089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:17:35.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150304+0000","last_change":"2024-04-15T23:37:54.976495+0000","last_active":"2024-04-15T23:38:04.150304+0000","last_peered":"2024-04-15T23:38:04.150304+0000","last_clean":"2024-04-15T23:38:04.150304+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:04.150304+0000","last_undegraded":"2024-04-15T23:38:04.150304+0000","last_fullsized":"2024-04-15T23:38:04.150304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:22:39.677169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054628+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:38:04.054628+0000","last_peered":"2024-04-15T23:38:04.054628+0000","last_clean":"2024-04-15T23:38:04.054628+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:04.054628+0000","last_undegraded":"2024-04-15T23:38:04.054628+0000","last_fullsized":"2024-04-15T23:38:04.054628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150576+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150576+0000","last_peered":"2024-04-15T23:38:04.150576+0000","last_clean":"2024-04-15T23:38:04.150576+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150576+0000","last_undegraded":"2024-04-15T23:38:04.150576+0000","last_fullsized":"2024-04-15T23:38:04.150576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:04:50.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054602+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054602+0000","last_peered":"2024-04-15T23:38:04.054602+0000","last_clean":"2024-04-15T23:38:04.054602+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054602+0000","last_undegraded":"2024-04-15T23:38:04.054602+0000","last_fullsized":"2024-04-15T23:38:04.054602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":361,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054539+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054539+0000","last_peered":"2024-04-15T23:38:04.054539+0000","last_clean":"2024-04-15T23:38:04.054539+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054539+0000","last_undegraded":"2024-04-15T23:38:04.054539+0000","last_fullsized":"2024-04-15T23:38:04.054539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:22.640720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055329+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:38:04.055329+0000","last_peered":"2024-04-15T23:38:04.055329+0000","last_clean":"2024-04-15T23:38:04.055329+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:04.055329+0000","last_undegraded":"2024-04-15T23:38:04.055329+0000","last_fullsized":"2024-04-15T23:38:04.055329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:37:54.980855+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:03.374439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055280+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055280+0000","last_peered":"2024-04-15T23:38:04.055280+0000","last_clean":"2024-04-15T23:38:04.055280+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055280+0000","last_undegraded":"2024-04-15T23:38:04.055280+0000","last_fullsized":"2024-04-15T23:38:04.055280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055018+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055018+0000","last_peered":"2024-04-15T23:38:04.055018+0000","last_clean":"2024-04-15T23:38:04.055018+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055018+0000","last_undegraded":"2024-04-15T23:38:04.055018+0000","last_fullsized":"2024-04-15T23:38:04.055018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055007+0000","last_change":"2024-04-15T23:37:54.969099+0000","last_active":"2024-04-15T23:38:04.055007+0000","last_peered":"2024-04-15T23:38:04.055007+0000","last_clean":"2024-04-15T23:38:04.055007+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:04.055007+0000","last_undegraded":"2024-04-15T23:38:04.055007+0000","last_fullsized":"2024-04-15T23:38:04.055007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:33:24.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150996+0000","last_change":"2024-04-15T23:37:54.977549+0000","last_active":"2024-04-15T23:38:04.150996+0000","last_peered":"2024-04-15T23:38:04.150996+0000","last_clean":"2024-04-15T23:38:04.150996+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:04.150996+0000","last_undegraded":"2024-04-15T23:38:04.150996+0000","last_fullsized":"2024-04-15T23:38:04.150996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:20:29.898627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054388+0000","last_change":"2024-04-15T23:37:54.983847+0000","last_active":"2024-04-15T23:38:04.054388+0000","last_peered":"2024-04-15T23:38:04.054388+0000","last_clean":"2024-04-15T23:38:04.054388+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:04.054388+0000","last_undegraded":"2024-04-15T23:38:04.054388+0000","last_fullsized":"2024-04-15T23:38:04.054388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:08:01.568734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150777+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150777+0000","last_peered":"2024-04-15T23:38:04.150777+0000","last_clean":"2024-04-15T23:38:04.150777+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150777+0000","last_undegraded":"2024-04-15T23:38:04.150777+0000","last_fullsized":"2024-04-15T23:38:04.150777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:56.623760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150376+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150376+0000","last_peered":"2024-04-15T23:38:04.150376+0000","last_clean":"2024-04-15T23:38:04.150376+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150376+0000","last_undegraded":"2024-04-15T23:38:04.150376+0000","last_fullsized":"2024-04-15T23:38:04.150376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:57:32.784527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":174,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:54:03.314247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150917+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150917+0000","last_peered":"2024-04-15T23:38:04.150917+0000","last_clean":"2024-04-15T23:38:04.150917+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150917+0000","last_undegraded":"2024-04-15T23:38:04.150917+0000","last_fullsized":"2024-04-15T23:38:04.150917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:42.892541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054473+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054473+0000","last_peered":"2024-04-15T23:38:04.054473+0000","last_clean":"2024-04-15T23:38:04.054473+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054473+0000","last_undegraded":"2024-04-15T23:38:04.054473+0000","last_fullsized":"2024-04-15T23:38:04.054473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:20:23.720332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055487+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.055487+0000","last_peered":"2024-04-15T23:38:04.055487+0000","last_clean":"2024-04-15T23:38:04.055487+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:04.055487+0000","last_undegraded":"2024-04-15T23:38:04.055487+0000","last_fullsized":"2024-04-15T23:38:04.055487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:11:04.686698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054313+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:38:04.054313+0000","last_peered":"2024-04-15T23:38:04.054313+0000","last_clean":"2024-04-15T23:38:04.054313+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:04.054313+0000","last_undegraded":"2024-04-15T23:38:04.054313+0000","last_fullsized":"2024-04-15T23:38:04.054313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055521+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055521+0000","last_peered":"2024-04-15T23:38:04.055521+0000","last_clean":"2024-04-15T23:38:04.055521+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055521+0000","last_undegraded":"2024-04-15T23:38:04.055521+0000","last_fullsized":"2024-04-15T23:38:04.055521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:37:38.502349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054157+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054157+0000","last_peered":"2024-04-15T23:38:04.054157+0000","last_clean":"2024-04-15T23:38:04.054157+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054157+0000","last_undegraded":"2024-04-15T23:38:04.054157+0000","last_fullsized":"2024-04-15T23:38:04.054157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":272,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:09.331923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054226+0000","last_change":"2024-04-15T23:37:54.969689+0000","last_active":"2024-04-15T23:38:04.054226+0000","last_peered":"2024-04-15T23:38:04.054226+0000","last_clean":"2024-04-15T23:38:04.054226+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:04.054226+0000","last_undegraded":"2024-04-15T23:38:04.054226+0000","last_fullsized":"2024-04-15T23:38:04.054226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:16:27.272034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054836+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054836+0000","last_peered":"2024-04-15T23:38:04.054836+0000","last_clean":"2024-04-15T23:38:04.054836+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054836+0000","last_undegraded":"2024-04-15T23:38:04.054836+0000","last_fullsized":"2024-04-15T23:38:04.054836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:37:11.947230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054669+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054669+0000","last_peered":"2024-04-15T23:38:04.054669+0000","last_clean":"2024-04-15T23:38:04.054669+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054669+0000","last_undegraded":"2024-04-15T23:38:04.054669+0000","last_fullsized":"2024-04-15T23:38:04.054669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054921+0000","last_change":"2024-04-15T23:37:54.983724+0000","last_active":"2024-04-15T23:38:04.054921+0000","last_peered":"2024-04-15T23:38:04.054921+0000","last_clean":"2024-04-15T23:38:04.054921+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:04.054921+0000","last_undegraded":"2024-04-15T23:38:04.054921+0000","last_fullsized":"2024-04-15T23:38:04.054921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:09.088379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":517,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150652+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150652+0000","last_peered":"2024-04-15T23:38:04.150652+0000","last_clean":"2024-04-15T23:38:04.150652+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150652+0000","last_undegraded":"2024-04-15T23:38:04.150652+0000","last_fullsized":"2024-04-15T23:38:04.150652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:01:49.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150486+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150486+0000","last_peered":"2024-04-15T23:38:04.150486+0000","last_clean":"2024-04-15T23:38:04.150486+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150486+0000","last_undegraded":"2024-04-15T23:38:04.150486+0000","last_fullsized":"2024-04-15T23:38:04.150486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:12.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150392+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150392+0000","last_peered":"2024-04-15T23:38:04.150392+0000","last_clean":"2024-04-15T23:38:04.150392+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150392+0000","last_undegraded":"2024-04-15T23:38:04.150392+0000","last_fullsized":"2024-04-15T23:38:04.150392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:10.597065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":210,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055160+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055160+0000","last_peered":"2024-04-15T23:38:04.055160+0000","last_clean":"2024-04-15T23:38:04.055160+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055160+0000","last_undegraded":"2024-04-15T23:38:04.055160+0000","last_fullsized":"2024-04-15T23:38:04.055160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:42.810034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054783+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054783+0000","last_peered":"2024-04-15T23:38:04.054783+0000","last_clean":"2024-04-15T23:38:04.054783+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054783+0000","last_undegraded":"2024-04-15T23:38:04.054783+0000","last_fullsized":"2024-04-15T23:38:04.054783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055412+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055412+0000","last_peered":"2024-04-15T23:38:04.055412+0000","last_clean":"2024-04-15T23:38:04.055412+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055412+0000","last_undegraded":"2024-04-15T23:38:04.055412+0000","last_fullsized":"2024-04-15T23:38:04.055412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":577,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150501+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150501+0000","last_peered":"2024-04-15T23:38:04.150501+0000","last_clean":"2024-04-15T23:38:04.150501+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150501+0000","last_undegraded":"2024-04-15T23:38:04.150501+0000","last_fullsized":"2024-04-15T23:38:04.150501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:42:50.642806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055152+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055152+0000","last_peered":"2024-04-15T23:38:04.055152+0000","last_clean":"2024-04-15T23:38:04.055152+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055152+0000","last_undegraded":"2024-04-15T23:38:04.055152+0000","last_fullsized":"2024-04-15T23:38:04.055152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:35:47.730630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103205,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85412,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286428,"statfs":{"total":96636764160,"available":96549302272,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80980,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290860,"statfs":{"total":96636764160,"available":96553840640,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88936,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282904,"statfs":{"total":96636764160,"available":96545693696,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:07.199 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-15T23:38:07.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-15T23:38:07.538 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-15T23:38:07.550 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-15T23:38:07.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:07.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:07.843 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:07.853 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-15T23:38:05.881474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255328,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860192,"statfs":{"total":289910292480,"available":289648836608,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.846081"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055400+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:38:04.055400+0000","last_peered":"2024-04-15T23:38:04.055400+0000","last_clean":"2024-04-15T23:38:04.055400+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:04.055400+0000","last_undegraded":"2024-04-15T23:38:04.055400+0000","last_fullsized":"2024-04-15T23:38:04.055400+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055039+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:38:04.055039+0000","last_peered":"2024-04-15T23:38:04.055039+0000","last_clean":"2024-04-15T23:38:04.055039+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:04.055039+0000","last_undegraded":"2024-04-15T23:38:04.055039+0000","last_fullsized":"2024-04-15T23:38:04.055039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151265+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151265+0000","last_peered":"2024-04-15T23:38:04.151265+0000","last_clean":"2024-04-15T23:38:04.151265+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151265+0000","last_undegraded":"2024-04-15T23:38:04.151265+0000","last_fullsized":"2024-04-15T23:38:04.151265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:18:46.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":446,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150655+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150655+0000","last_peered":"2024-04-15T23:38:04.150655+0000","last_clean":"2024-04-15T23:38:04.150655+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150655+0000","last_undegraded":"2024-04-15T23:38:04.150655+0000","last_fullsized":"2024-04-15T23:38:04.150655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:06:46.388157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150937+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.150937+0000","last_peered":"2024-04-15T23:38:04.150937+0000","last_clean":"2024-04-15T23:38:04.150937+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.150937+0000","last_undegraded":"2024-04-15T23:38:04.150937+0000","last_fullsized":"2024-04-15T23:38:04.150937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:49:46.849666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:57.967361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":461,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150156+0000","last_change":"2024-04-15T23:37:54.979553+0000","last_active":"2024-04-15T23:38:04.150156+0000","last_peered":"2024-04-15T23:38:04.150156+0000","last_clean":"2024-04-15T23:38:04.150156+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:04.150156+0000","last_undegraded":"2024-04-15T23:38:04.150156+0000","last_fullsized":"2024-04-15T23:38:04.150156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:10:07.716446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055404+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:38:04.055404+0000","last_peered":"2024-04-15T23:38:04.055404+0000","last_clean":"2024-04-15T23:38:04.055404+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:04.055404+0000","last_undegraded":"2024-04-15T23:38:04.055404+0000","last_fullsized":"2024-04-15T23:38:04.055404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055091+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:38:04.055091+0000","last_peered":"2024-04-15T23:38:04.055091+0000","last_clean":"2024-04-15T23:38:04.055091+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:04.055091+0000","last_undegraded":"2024-04-15T23:38:04.055091+0000","last_fullsized":"2024-04-15T23:38:04.055091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":495,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151157+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151157+0000","last_peered":"2024-04-15T23:38:04.151157+0000","last_clean":"2024-04-15T23:38:04.151157+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151157+0000","last_undegraded":"2024-04-15T23:38:04.151157+0000","last_fullsized":"2024-04-15T23:38:04.151157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:44.888221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:37:54.980913+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:05.402863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":462,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054625+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:38:04.054625+0000","last_peered":"2024-04-15T23:38:04.054625+0000","last_clean":"2024-04-15T23:38:04.054625+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:04.054625+0000","last_undegraded":"2024-04-15T23:38:04.054625+0000","last_fullsized":"2024-04-15T23:38:04.054625+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":288,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150828+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150828+0000","last_peered":"2024-04-15T23:38:04.150828+0000","last_clean":"2024-04-15T23:38:04.150828+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150828+0000","last_undegraded":"2024-04-15T23:38:04.150828+0000","last_fullsized":"2024-04-15T23:38:04.150828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:13:18.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150330+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150330+0000","last_peered":"2024-04-15T23:38:04.150330+0000","last_clean":"2024-04-15T23:38:04.150330+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150330+0000","last_undegraded":"2024-04-15T23:38:04.150330+0000","last_fullsized":"2024-04-15T23:38:04.150330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:29:51.531478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":547,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150536+0000","last_change":"2024-04-15T23:37:54.977342+0000","last_active":"2024-04-15T23:38:04.150536+0000","last_peered":"2024-04-15T23:38:04.150536+0000","last_clean":"2024-04-15T23:38:04.150536+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:04.150536+0000","last_undegraded":"2024-04-15T23:38:04.150536+0000","last_fullsized":"2024-04-15T23:38:04.150536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:08:13.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055354+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:38:04.055354+0000","last_peered":"2024-04-15T23:38:04.055354+0000","last_clean":"2024-04-15T23:38:04.055354+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:04.055354+0000","last_undegraded":"2024-04-15T23:38:04.055354+0000","last_fullsized":"2024-04-15T23:38:04.055354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055324+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:38:04.055324+0000","last_peered":"2024-04-15T23:38:04.055324+0000","last_clean":"2024-04-15T23:38:04.055324+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:04.055324+0000","last_undegraded":"2024-04-15T23:38:04.055324+0000","last_fullsized":"2024-04-15T23:38:04.055324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":252,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054942+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:38:04.054942+0000","last_peered":"2024-04-15T23:38:04.054942+0000","last_clean":"2024-04-15T23:38:04.054942+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:04.054942+0000","last_undegraded":"2024-04-15T23:38:04.054942+0000","last_fullsized":"2024-04-15T23:38:04.054942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150860+0000","last_change":"2024-04-15T23:37:54.974826+0000","last_active":"2024-04-15T23:38:04.150860+0000","last_peered":"2024-04-15T23:38:04.150860+0000","last_clean":"2024-04-15T23:38:04.150860+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:04.150860+0000","last_undegraded":"2024-04-15T23:38:04.150860+0000","last_fullsized":"2024-04-15T23:38:04.150860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:36.179704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":516,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151233+0000","last_change":"2024-04-15T23:37:54.975373+0000","last_active":"2024-04-15T23:38:04.151233+0000","last_peered":"2024-04-15T23:38:04.151233+0000","last_clean":"2024-04-15T23:38:04.151233+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:04.151233+0000","last_undegraded":"2024-04-15T23:38:04.151233+0000","last_fullsized":"2024-04-15T23:38:04.151233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:44.503479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054482+0000","last_change":"2024-04-15T23:37:54.984078+0000","last_active":"2024-04-15T23:38:04.054482+0000","last_peered":"2024-04-15T23:38:04.054482+0000","last_clean":"2024-04-15T23:38:04.054482+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:04.054482+0000","last_undegraded":"2024-04-15T23:38:04.054482+0000","last_fullsized":"2024-04-15T23:38:04.054482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:04:28.242880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054340+0000","last_change":"2024-04-15T23:37:54.970987+0000","last_active":"2024-04-15T23:38:04.054340+0000","last_peered":"2024-04-15T23:38:04.054340+0000","last_clean":"2024-04-15T23:38:04.054340+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:04.054340+0000","last_undegraded":"2024-04-15T23:38:04.054340+0000","last_fullsized":"2024-04-15T23:38:04.054340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:54.676743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054295+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054295+0000","last_peered":"2024-04-15T23:38:04.054295+0000","last_clean":"2024-04-15T23:38:04.054295+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054295+0000","last_undegraded":"2024-04-15T23:38:04.054295+0000","last_fullsized":"2024-04-15T23:38:04.054295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055405+0000","last_change":"2024-04-15T23:37:54.980092+0000","last_active":"2024-04-15T23:38:04.055405+0000","last_peered":"2024-04-15T23:38:04.055405+0000","last_clean":"2024-04-15T23:38:04.055405+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:04.055405+0000","last_undegraded":"2024-04-15T23:38:04.055405+0000","last_fullsized":"2024-04-15T23:38:04.055405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:57.488763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055369+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055369+0000","last_peered":"2024-04-15T23:38:04.055369+0000","last_clean":"2024-04-15T23:38:04.055369+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055369+0000","last_undegraded":"2024-04-15T23:38:04.055369+0000","last_fullsized":"2024-04-15T23:38:04.055369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:15:42.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":267,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151158+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151158+0000","last_peered":"2024-04-15T23:38:04.151158+0000","last_clean":"2024-04-15T23:38:04.151158+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151158+0000","last_undegraded":"2024-04-15T23:38:04.151158+0000","last_fullsized":"2024-04-15T23:38:04.151158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:08.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055032+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055032+0000","last_peered":"2024-04-15T23:38:04.055032+0000","last_clean":"2024-04-15T23:38:04.055032+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055032+0000","last_undegraded":"2024-04-15T23:38:04.055032+0000","last_fullsized":"2024-04-15T23:38:04.055032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:56.957050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054430+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:38:04.054430+0000","last_peered":"2024-04-15T23:38:04.054430+0000","last_clean":"2024-04-15T23:38:04.054430+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:04.054430+0000","last_undegraded":"2024-04-15T23:38:04.054430+0000","last_fullsized":"2024-04-15T23:38:04.054430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054605+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054605+0000","last_peered":"2024-04-15T23:38:04.054605+0000","last_clean":"2024-04-15T23:38:04.054605+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054605+0000","last_undegraded":"2024-04-15T23:38:04.054605+0000","last_fullsized":"2024-04-15T23:38:04.054605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:42:47.190183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054713+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054713+0000","last_peered":"2024-04-15T23:38:04.054713+0000","last_clean":"2024-04-15T23:38:04.054713+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054713+0000","last_undegraded":"2024-04-15T23:38:04.054713+0000","last_fullsized":"2024-04-15T23:38:04.054713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150050+0000","last_change":"2024-04-15T23:37:54.979663+0000","last_active":"2024-04-15T23:38:04.150050+0000","last_peered":"2024-04-15T23:38:04.150050+0000","last_clean":"2024-04-15T23:38:04.150050+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:04.150050+0000","last_undegraded":"2024-04-15T23:38:04.150050+0000","last_fullsized":"2024-04-15T23:38:04.150050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:16:39.846762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150353+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150353+0000","last_peered":"2024-04-15T23:38:04.150353+0000","last_clean":"2024-04-15T23:38:04.150353+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150353+0000","last_undegraded":"2024-04-15T23:38:04.150353+0000","last_fullsized":"2024-04-15T23:38:04.150353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:45:18.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055118+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055118+0000","last_peered":"2024-04-15T23:38:04.055118+0000","last_clean":"2024-04-15T23:38:04.055118+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055118+0000","last_undegraded":"2024-04-15T23:38:04.055118+0000","last_fullsized":"2024-04-15T23:38:04.055118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054459+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054459+0000","last_peered":"2024-04-15T23:38:04.054459+0000","last_clean":"2024-04-15T23:38:04.054459+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054459+0000","last_undegraded":"2024-04-15T23:38:04.054459+0000","last_fullsized":"2024-04-15T23:38:04.054459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:48.663512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":309,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.970465+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:21.553276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054650+0000","last_change":"2024-04-15T23:37:54.975024+0000","last_active":"2024-04-15T23:38:04.054650+0000","last_peered":"2024-04-15T23:38:04.054650+0000","last_clean":"2024-04-15T23:38:04.054650+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:04.054650+0000","last_undegraded":"2024-04-15T23:38:04.054650+0000","last_fullsized":"2024-04-15T23:38:04.054650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:07:57.085578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055211+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055211+0000","last_peered":"2024-04-15T23:38:04.055211+0000","last_clean":"2024-04-15T23:38:04.055211+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055211+0000","last_undegraded":"2024-04-15T23:38:04.055211+0000","last_fullsized":"2024-04-15T23:38:04.055211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:45.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150030+0000","last_change":"2024-04-15T23:37:54.980128+0000","last_active":"2024-04-15T23:38:04.150030+0000","last_peered":"2024-04-15T23:38:04.150030+0000","last_clean":"2024-04-15T23:38:04.150030+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:04.150030+0000","last_undegraded":"2024-04-15T23:38:04.150030+0000","last_fullsized":"2024-04-15T23:38:04.150030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:26:41.575192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151238+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151238+0000","last_peered":"2024-04-15T23:38:04.151238+0000","last_clean":"2024-04-15T23:38:04.151238+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151238+0000","last_undegraded":"2024-04-15T23:38:04.151238+0000","last_fullsized":"2024-04-15T23:38:04.151238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:43.826554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":303,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054304+0000","last_change":"2024-04-15T23:37:54.980087+0000","last_active":"2024-04-15T23:38:04.054304+0000","last_peered":"2024-04-15T23:38:04.054304+0000","last_clean":"2024-04-15T23:38:04.054304+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:04.054304+0000","last_undegraded":"2024-04-15T23:38:04.054304+0000","last_fullsized":"2024-04-15T23:38:04.054304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:40:49.638064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055338+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:04.055338+0000","last_peered":"2024-04-15T23:38:04.055338+0000","last_clean":"2024-04-15T23:38:04.055338+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:04.055338+0000","last_undegraded":"2024-04-15T23:38:04.055338+0000","last_fullsized":"2024-04-15T23:38:04.055338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:57.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":566,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054387+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054387+0000","last_peered":"2024-04-15T23:38:04.054387+0000","last_clean":"2024-04-15T23:38:04.054387+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054387+0000","last_undegraded":"2024-04-15T23:38:04.054387+0000","last_fullsized":"2024-04-15T23:38:04.054387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150879+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.150879+0000","last_peered":"2024-04-15T23:38:04.150879+0000","last_clean":"2024-04-15T23:38:04.150879+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.150879+0000","last_undegraded":"2024-04-15T23:38:04.150879+0000","last_fullsized":"2024-04-15T23:38:04.150879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:38:27.066961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151007+0000","last_change":"2024-04-15T23:37:54.975622+0000","last_active":"2024-04-15T23:38:04.151007+0000","last_peered":"2024-04-15T23:38:04.151007+0000","last_clean":"2024-04-15T23:38:04.151007+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:04.151007+0000","last_undegraded":"2024-04-15T23:38:04.151007+0000","last_fullsized":"2024-04-15T23:38:04.151007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:17:12.523528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150683+0000","last_change":"2024-04-15T23:37:54.974738+0000","last_active":"2024-04-15T23:38:04.150683+0000","last_peered":"2024-04-15T23:38:04.150683+0000","last_clean":"2024-04-15T23:38:04.150683+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:04.150683+0000","last_undegraded":"2024-04-15T23:38:04.150683+0000","last_fullsized":"2024-04-15T23:38:04.150683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:41:17.825004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055234+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055234+0000","last_peered":"2024-04-15T23:38:04.055234+0000","last_clean":"2024-04-15T23:38:04.055234+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055234+0000","last_undegraded":"2024-04-15T23:38:04.055234+0000","last_fullsized":"2024-04-15T23:38:04.055234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:50:08.878782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054981+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.054981+0000","last_peered":"2024-04-15T23:38:04.054981+0000","last_clean":"2024-04-15T23:38:04.054981+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.054981+0000","last_undegraded":"2024-04-15T23:38:04.054981+0000","last_fullsized":"2024-04-15T23:38:04.054981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:46:16.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150966+0000","last_change":"2024-04-15T23:37:54.975504+0000","last_active":"2024-04-15T23:38:04.150966+0000","last_peered":"2024-04-15T23:38:04.150966+0000","last_clean":"2024-04-15T23:38:04.150966+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:04.150966+0000","last_undegraded":"2024-04-15T23:38:04.150966+0000","last_fullsized":"2024-04-15T23:38:04.150966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:54:46.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150389+0000","last_change":"2024-04-15T23:37:54.974969+0000","last_active":"2024-04-15T23:38:04.150389+0000","last_peered":"2024-04-15T23:38:04.150389+0000","last_clean":"2024-04-15T23:38:04.150389+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:04.150389+0000","last_undegraded":"2024-04-15T23:38:04.150389+0000","last_fullsized":"2024-04-15T23:38:04.150389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:24.991458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150768+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150768+0000","last_peered":"2024-04-15T23:38:04.150768+0000","last_clean":"2024-04-15T23:38:04.150768+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150768+0000","last_undegraded":"2024-04-15T23:38:04.150768+0000","last_fullsized":"2024-04-15T23:38:04.150768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:45:24.736666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054719+0000","last_change":"2024-04-15T23:37:54.975484+0000","last_active":"2024-04-15T23:38:04.054719+0000","last_peered":"2024-04-15T23:38:04.054719+0000","last_clean":"2024-04-15T23:38:04.054719+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:04.054719+0000","last_undegraded":"2024-04-15T23:38:04.054719+0000","last_fullsized":"2024-04-15T23:38:04.054719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:35.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151067+0000","last_change":"2024-04-15T23:37:54.979558+0000","last_active":"2024-04-15T23:38:04.151067+0000","last_peered":"2024-04-15T23:38:04.151067+0000","last_clean":"2024-04-15T23:38:04.151067+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:04.151067+0000","last_undegraded":"2024-04-15T23:38:04.151067+0000","last_fullsized":"2024-04-15T23:38:04.151067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:34:18.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054445+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054445+0000","last_peered":"2024-04-15T23:38:04.054445+0000","last_clean":"2024-04-15T23:38:04.054445+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054445+0000","last_undegraded":"2024-04-15T23:38:04.054445+0000","last_fullsized":"2024-04-15T23:38:04.054445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055602+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:38:04.055602+0000","last_peered":"2024-04-15T23:38:04.055602+0000","last_clean":"2024-04-15T23:38:04.055602+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:04.055602+0000","last_undegraded":"2024-04-15T23:38:04.055602+0000","last_fullsized":"2024-04-15T23:38:04.055602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.149931+0000","last_change":"2024-04-15T23:37:54.980406+0000","last_active":"2024-04-15T23:38:04.149931+0000","last_peered":"2024-04-15T23:38:04.149931+0000","last_clean":"2024-04-15T23:38:04.149931+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:04.149931+0000","last_undegraded":"2024-04-15T23:38:04.149931+0000","last_fullsized":"2024-04-15T23:38:04.149931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:06.260508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150220+0000","last_change":"2024-04-15T23:37:54.975952+0000","last_active":"2024-04-15T23:38:04.150220+0000","last_peered":"2024-04-15T23:38:04.150220+0000","last_clean":"2024-04-15T23:38:04.150220+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:04.150220+0000","last_undegraded":"2024-04-15T23:38:04.150220+0000","last_fullsized":"2024-04-15T23:38:04.150220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:11.183075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054759+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054759+0000","last_peered":"2024-04-15T23:38:04.054759+0000","last_clean":"2024-04-15T23:38:04.054759+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054759+0000","last_undegraded":"2024-04-15T23:38:04.054759+0000","last_fullsized":"2024-04-15T23:38:04.054759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151039+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151039+0000","last_peered":"2024-04-15T23:38:04.151039+0000","last_clean":"2024-04-15T23:38:04.151039+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151039+0000","last_undegraded":"2024-04-15T23:38:04.151039+0000","last_fullsized":"2024-04-15T23:38:04.151039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:20:33.862210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150243+0000","last_change":"2024-04-15T23:37:54.980322+0000","last_active":"2024-04-15T23:38:04.150243+0000","last_peered":"2024-04-15T23:38:04.150243+0000","last_clean":"2024-04-15T23:38:04.150243+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:04.150243+0000","last_undegraded":"2024-04-15T23:38:04.150243+0000","last_fullsized":"2024-04-15T23:38:04.150243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:04:30.063643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054307+0000","last_change":"2024-04-15T23:37:54.969392+0000","last_active":"2024-04-15T23:38:04.054307+0000","last_peered":"2024-04-15T23:38:04.054307+0000","last_clean":"2024-04-15T23:38:04.054307+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:04.054307+0000","last_undegraded":"2024-04-15T23:38:04.054307+0000","last_fullsized":"2024-04-15T23:38:04.054307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:34.602096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055197+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:38:04.055197+0000","last_peered":"2024-04-15T23:38:04.055197+0000","last_clean":"2024-04-15T23:38:04.055197+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:04.055197+0000","last_undegraded":"2024-04-15T23:38:04.055197+0000","last_fullsized":"2024-04-15T23:38:04.055197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054520+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054520+0000","last_peered":"2024-04-15T23:38:04.054520+0000","last_clean":"2024-04-15T23:38:04.054520+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054520+0000","last_undegraded":"2024-04-15T23:38:04.054520+0000","last_fullsized":"2024-04-15T23:38:04.054520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":208,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054569+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.054569+0000","last_peered":"2024-04-15T23:38:04.054569+0000","last_clean":"2024-04-15T23:38:04.054569+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:04.054569+0000","last_undegraded":"2024-04-15T23:38:04.054569+0000","last_fullsized":"2024-04-15T23:38:04.054569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:00:37.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055575+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:38:04.055575+0000","last_peered":"2024-04-15T23:38:04.055575+0000","last_clean":"2024-04-15T23:38:04.055575+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:04.055575+0000","last_undegraded":"2024-04-15T23:38:04.055575+0000","last_fullsized":"2024-04-15T23:38:04.055575+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150089+0000","last_change":"2024-04-15T23:37:54.974977+0000","last_active":"2024-04-15T23:38:04.150089+0000","last_peered":"2024-04-15T23:38:04.150089+0000","last_clean":"2024-04-15T23:38:04.150089+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:04.150089+0000","last_undegraded":"2024-04-15T23:38:04.150089+0000","last_fullsized":"2024-04-15T23:38:04.150089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:17:35.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150304+0000","last_change":"2024-04-15T23:37:54.976495+0000","last_active":"2024-04-15T23:38:04.150304+0000","last_peered":"2024-04-15T23:38:04.150304+0000","last_clean":"2024-04-15T23:38:04.150304+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:04.150304+0000","last_undegraded":"2024-04-15T23:38:04.150304+0000","last_fullsized":"2024-04-15T23:38:04.150304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:22:39.677169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054628+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:38:04.054628+0000","last_peered":"2024-04-15T23:38:04.054628+0000","last_clean":"2024-04-15T23:38:04.054628+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:04.054628+0000","last_undegraded":"2024-04-15T23:38:04.054628+0000","last_fullsized":"2024-04-15T23:38:04.054628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150576+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150576+0000","last_peered":"2024-04-15T23:38:04.150576+0000","last_clean":"2024-04-15T23:38:04.150576+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150576+0000","last_undegraded":"2024-04-15T23:38:04.150576+0000","last_fullsized":"2024-04-15T23:38:04.150576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:04:50.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054602+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054602+0000","last_peered":"2024-04-15T23:38:04.054602+0000","last_clean":"2024-04-15T23:38:04.054602+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054602+0000","last_undegraded":"2024-04-15T23:38:04.054602+0000","last_fullsized":"2024-04-15T23:38:04.054602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":361,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054539+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054539+0000","last_peered":"2024-04-15T23:38:04.054539+0000","last_clean":"2024-04-15T23:38:04.054539+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054539+0000","last_undegraded":"2024-04-15T23:38:04.054539+0000","last_fullsized":"2024-04-15T23:38:04.054539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:22.640720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055329+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:38:04.055329+0000","last_peered":"2024-04-15T23:38:04.055329+0000","last_clean":"2024-04-15T23:38:04.055329+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:04.055329+0000","last_undegraded":"2024-04-15T23:38:04.055329+0000","last_fullsized":"2024-04-15T23:38:04.055329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:37:54.980855+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:03.374439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055280+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055280+0000","last_peered":"2024-04-15T23:38:04.055280+0000","last_clean":"2024-04-15T23:38:04.055280+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055280+0000","last_undegraded":"2024-04-15T23:38:04.055280+0000","last_fullsized":"2024-04-15T23:38:04.055280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055018+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055018+0000","last_peered":"2024-04-15T23:38:04.055018+0000","last_clean":"2024-04-15T23:38:04.055018+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055018+0000","last_undegraded":"2024-04-15T23:38:04.055018+0000","last_fullsized":"2024-04-15T23:38:04.055018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055007+0000","last_change":"2024-04-15T23:37:54.969099+0000","last_active":"2024-04-15T23:38:04.055007+0000","last_peered":"2024-04-15T23:38:04.055007+0000","last_clean":"2024-04-15T23:38:04.055007+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:04.055007+0000","last_undegraded":"2024-04-15T23:38:04.055007+0000","last_fullsized":"2024-04-15T23:38:04.055007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:33:24.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150996+0000","last_change":"2024-04-15T23:37:54.977549+0000","last_active":"2024-04-15T23:38:04.150996+0000","last_peered":"2024-04-15T23:38:04.150996+0000","last_clean":"2024-04-15T23:38:04.150996+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:04.150996+0000","last_undegraded":"2024-04-15T23:38:04.150996+0000","last_fullsized":"2024-04-15T23:38:04.150996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:20:29.898627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054388+0000","last_change":"2024-04-15T23:37:54.983847+0000","last_active":"2024-04-15T23:38:04.054388+0000","last_peered":"2024-04-15T23:38:04.054388+0000","last_clean":"2024-04-15T23:38:04.054388+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:04.054388+0000","last_undegraded":"2024-04-15T23:38:04.054388+0000","last_fullsized":"2024-04-15T23:38:04.054388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:08:01.568734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150777+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150777+0000","last_peered":"2024-04-15T23:38:04.150777+0000","last_clean":"2024-04-15T23:38:04.150777+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150777+0000","last_undegraded":"2024-04-15T23:38:04.150777+0000","last_fullsized":"2024-04-15T23:38:04.150777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:56.623760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150376+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150376+0000","last_peered":"2024-04-15T23:38:04.150376+0000","last_clean":"2024-04-15T23:38:04.150376+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150376+0000","last_undegraded":"2024-04-15T23:38:04.150376+0000","last_fullsized":"2024-04-15T23:38:04.150376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:57:32.784527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":174,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:54:03.314247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150917+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150917+0000","last_peered":"2024-04-15T23:38:04.150917+0000","last_clean":"2024-04-15T23:38:04.150917+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150917+0000","last_undegraded":"2024-04-15T23:38:04.150917+0000","last_fullsized":"2024-04-15T23:38:04.150917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:42.892541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054473+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054473+0000","last_peered":"2024-04-15T23:38:04.054473+0000","last_clean":"2024-04-15T23:38:04.054473+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054473+0000","last_undegraded":"2024-04-15T23:38:04.054473+0000","last_fullsized":"2024-04-15T23:38:04.054473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:20:23.720332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055487+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.055487+0000","last_peered":"2024-04-15T23:38:04.055487+0000","last_clean":"2024-04-15T23:38:04.055487+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:04.055487+0000","last_undegraded":"2024-04-15T23:38:04.055487+0000","last_fullsized":"2024-04-15T23:38:04.055487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:11:04.686698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054313+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:38:04.054313+0000","last_peered":"2024-04-15T23:38:04.054313+0000","last_clean":"2024-04-15T23:38:04.054313+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:04.054313+0000","last_undegraded":"2024-04-15T23:38:04.054313+0000","last_fullsized":"2024-04-15T23:38:04.054313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055521+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055521+0000","last_peered":"2024-04-15T23:38:04.055521+0000","last_clean":"2024-04-15T23:38:04.055521+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055521+0000","last_undegraded":"2024-04-15T23:38:04.055521+0000","last_fullsized":"2024-04-15T23:38:04.055521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:37:38.502349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054157+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054157+0000","last_peered":"2024-04-15T23:38:04.054157+0000","last_clean":"2024-04-15T23:38:04.054157+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054157+0000","last_undegraded":"2024-04-15T23:38:04.054157+0000","last_fullsized":"2024-04-15T23:38:04.054157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":272,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:09.331923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054226+0000","last_change":"2024-04-15T23:37:54.969689+0000","last_active":"2024-04-15T23:38:04.054226+0000","last_peered":"2024-04-15T23:38:04.054226+0000","last_clean":"2024-04-15T23:38:04.054226+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:04.054226+0000","last_undegraded":"2024-04-15T23:38:04.054226+0000","last_fullsized":"2024-04-15T23:38:04.054226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:16:27.272034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054836+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054836+0000","last_peered":"2024-04-15T23:38:04.054836+0000","last_clean":"2024-04-15T23:38:04.054836+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054836+0000","last_undegraded":"2024-04-15T23:38:04.054836+0000","last_fullsized":"2024-04-15T23:38:04.054836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:37:11.947230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054669+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054669+0000","last_peered":"2024-04-15T23:38:04.054669+0000","last_clean":"2024-04-15T23:38:04.054669+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054669+0000","last_undegraded":"2024-04-15T23:38:04.054669+0000","last_fullsized":"2024-04-15T23:38:04.054669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054921+0000","last_change":"2024-04-15T23:37:54.983724+0000","last_active":"2024-04-15T23:38:04.054921+0000","last_peered":"2024-04-15T23:38:04.054921+0000","last_clean":"2024-04-15T23:38:04.054921+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:04.054921+0000","last_undegraded":"2024-04-15T23:38:04.054921+0000","last_fullsized":"2024-04-15T23:38:04.054921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:09.088379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":517,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150652+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150652+0000","last_peered":"2024-04-15T23:38:04.150652+0000","last_clean":"2024-04-15T23:38:04.150652+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150652+0000","last_undegraded":"2024-04-15T23:38:04.150652+0000","last_fullsized":"2024-04-15T23:38:04.150652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:01:49.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150486+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150486+0000","last_peered":"2024-04-15T23:38:04.150486+0000","last_clean":"2024-04-15T23:38:04.150486+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150486+0000","last_undegraded":"2024-04-15T23:38:04.150486+0000","last_fullsized":"2024-04-15T23:38:04.150486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:12.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150392+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150392+0000","last_peered":"2024-04-15T23:38:04.150392+0000","last_clean":"2024-04-15T23:38:04.150392+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150392+0000","last_undegraded":"2024-04-15T23:38:04.150392+0000","last_fullsized":"2024-04-15T23:38:04.150392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:10.597065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":210,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055160+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055160+0000","last_peered":"2024-04-15T23:38:04.055160+0000","last_clean":"2024-04-15T23:38:04.055160+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055160+0000","last_undegraded":"2024-04-15T23:38:04.055160+0000","last_fullsized":"2024-04-15T23:38:04.055160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:42.810034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054783+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054783+0000","last_peered":"2024-04-15T23:38:04.054783+0000","last_clean":"2024-04-15T23:38:04.054783+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054783+0000","last_undegraded":"2024-04-15T23:38:04.054783+0000","last_fullsized":"2024-04-15T23:38:04.054783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055412+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055412+0000","last_peered":"2024-04-15T23:38:04.055412+0000","last_clean":"2024-04-15T23:38:04.055412+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055412+0000","last_undegraded":"2024-04-15T23:38:04.055412+0000","last_fullsized":"2024-04-15T23:38:04.055412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":577,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150501+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150501+0000","last_peered":"2024-04-15T23:38:04.150501+0000","last_clean":"2024-04-15T23:38:04.150501+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150501+0000","last_undegraded":"2024-04-15T23:38:04.150501+0000","last_fullsized":"2024-04-15T23:38:04.150501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:42:50.642806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055152+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055152+0000","last_peered":"2024-04-15T23:38:04.055152+0000","last_clean":"2024-04-15T23:38:04.055152+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055152+0000","last_undegraded":"2024-04-15T23:38:04.055152+0000","last_fullsized":"2024-04-15T23:38:04.055152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:35:47.730630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103205,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85412,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286428,"statfs":{"total":96636764160,"available":96549302272,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80980,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290860,"statfs":{"total":96636764160,"available":96553840640,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88936,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282904,"statfs":{"total":96636764160,"available":96545693696,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:07.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:08.183 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:08.185 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:08.195 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-04-15T23:38:07.881907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255328,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860192,"statfs":{"total":289910292480,"available":289648836608,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001200"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055400+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:38:04.055400+0000","last_peered":"2024-04-15T23:38:04.055400+0000","last_clean":"2024-04-15T23:38:04.055400+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:04.055400+0000","last_undegraded":"2024-04-15T23:38:04.055400+0000","last_fullsized":"2024-04-15T23:38:04.055400+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055039+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:38:04.055039+0000","last_peered":"2024-04-15T23:38:04.055039+0000","last_clean":"2024-04-15T23:38:04.055039+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:04.055039+0000","last_undegraded":"2024-04-15T23:38:04.055039+0000","last_fullsized":"2024-04-15T23:38:04.055039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151265+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151265+0000","last_peered":"2024-04-15T23:38:04.151265+0000","last_clean":"2024-04-15T23:38:04.151265+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151265+0000","last_undegraded":"2024-04-15T23:38:04.151265+0000","last_fullsized":"2024-04-15T23:38:04.151265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:18:46.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":446,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150655+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150655+0000","last_peered":"2024-04-15T23:38:04.150655+0000","last_clean":"2024-04-15T23:38:04.150655+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150655+0000","last_undegraded":"2024-04-15T23:38:04.150655+0000","last_fullsized":"2024-04-15T23:38:04.150655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:06:46.388157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150937+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.150937+0000","last_peered":"2024-04-15T23:38:04.150937+0000","last_clean":"2024-04-15T23:38:04.150937+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.150937+0000","last_undegraded":"2024-04-15T23:38:04.150937+0000","last_fullsized":"2024-04-15T23:38:04.150937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:49:46.849666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:57.967361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":461,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150156+0000","last_change":"2024-04-15T23:37:54.979553+0000","last_active":"2024-04-15T23:38:04.150156+0000","last_peered":"2024-04-15T23:38:04.150156+0000","last_clean":"2024-04-15T23:38:04.150156+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:04.150156+0000","last_undegraded":"2024-04-15T23:38:04.150156+0000","last_fullsized":"2024-04-15T23:38:04.150156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:10:07.716446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055404+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:38:04.055404+0000","last_peered":"2024-04-15T23:38:04.055404+0000","last_clean":"2024-04-15T23:38:04.055404+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:04.055404+0000","last_undegraded":"2024-04-15T23:38:04.055404+0000","last_fullsized":"2024-04-15T23:38:04.055404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055091+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:38:04.055091+0000","last_peered":"2024-04-15T23:38:04.055091+0000","last_clean":"2024-04-15T23:38:04.055091+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:04.055091+0000","last_undegraded":"2024-04-15T23:38:04.055091+0000","last_fullsized":"2024-04-15T23:38:04.055091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":495,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151157+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151157+0000","last_peered":"2024-04-15T23:38:04.151157+0000","last_clean":"2024-04-15T23:38:04.151157+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151157+0000","last_undegraded":"2024-04-15T23:38:04.151157+0000","last_fullsized":"2024-04-15T23:38:04.151157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:44.888221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:37:54.980913+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:05.402863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":462,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054625+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:38:04.054625+0000","last_peered":"2024-04-15T23:38:04.054625+0000","last_clean":"2024-04-15T23:38:04.054625+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:04.054625+0000","last_undegraded":"2024-04-15T23:38:04.054625+0000","last_fullsized":"2024-04-15T23:38:04.054625+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":288,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150828+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150828+0000","last_peered":"2024-04-15T23:38:04.150828+0000","last_clean":"2024-04-15T23:38:04.150828+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150828+0000","last_undegraded":"2024-04-15T23:38:04.150828+0000","last_fullsized":"2024-04-15T23:38:04.150828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:13:18.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150330+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150330+0000","last_peered":"2024-04-15T23:38:04.150330+0000","last_clean":"2024-04-15T23:38:04.150330+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150330+0000","last_undegraded":"2024-04-15T23:38:04.150330+0000","last_fullsized":"2024-04-15T23:38:04.150330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:29:51.531478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":547,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150536+0000","last_change":"2024-04-15T23:37:54.977342+0000","last_active":"2024-04-15T23:38:04.150536+0000","last_peered":"2024-04-15T23:38:04.150536+0000","last_clean":"2024-04-15T23:38:04.150536+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:04.150536+0000","last_undegraded":"2024-04-15T23:38:04.150536+0000","last_fullsized":"2024-04-15T23:38:04.150536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:08:13.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055354+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:38:04.055354+0000","last_peered":"2024-04-15T23:38:04.055354+0000","last_clean":"2024-04-15T23:38:04.055354+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:04.055354+0000","last_undegraded":"2024-04-15T23:38:04.055354+0000","last_fullsized":"2024-04-15T23:38:04.055354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055324+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:38:04.055324+0000","last_peered":"2024-04-15T23:38:04.055324+0000","last_clean":"2024-04-15T23:38:04.055324+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:04.055324+0000","last_undegraded":"2024-04-15T23:38:04.055324+0000","last_fullsized":"2024-04-15T23:38:04.055324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":252,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054942+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:38:04.054942+0000","last_peered":"2024-04-15T23:38:04.054942+0000","last_clean":"2024-04-15T23:38:04.054942+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:04.054942+0000","last_undegraded":"2024-04-15T23:38:04.054942+0000","last_fullsized":"2024-04-15T23:38:04.054942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150860+0000","last_change":"2024-04-15T23:37:54.974826+0000","last_active":"2024-04-15T23:38:04.150860+0000","last_peered":"2024-04-15T23:38:04.150860+0000","last_clean":"2024-04-15T23:38:04.150860+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:04.150860+0000","last_undegraded":"2024-04-15T23:38:04.150860+0000","last_fullsized":"2024-04-15T23:38:04.150860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:36.179704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":516,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151233+0000","last_change":"2024-04-15T23:37:54.975373+0000","last_active":"2024-04-15T23:38:04.151233+0000","last_peered":"2024-04-15T23:38:04.151233+0000","last_clean":"2024-04-15T23:38:04.151233+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:04.151233+0000","last_undegraded":"2024-04-15T23:38:04.151233+0000","last_fullsized":"2024-04-15T23:38:04.151233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:44.503479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054482+0000","last_change":"2024-04-15T23:37:54.984078+0000","last_active":"2024-04-15T23:38:04.054482+0000","last_peered":"2024-04-15T23:38:04.054482+0000","last_clean":"2024-04-15T23:38:04.054482+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:04.054482+0000","last_undegraded":"2024-04-15T23:38:04.054482+0000","last_fullsized":"2024-04-15T23:38:04.054482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:04:28.242880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054340+0000","last_change":"2024-04-15T23:37:54.970987+0000","last_active":"2024-04-15T23:38:04.054340+0000","last_peered":"2024-04-15T23:38:04.054340+0000","last_clean":"2024-04-15T23:38:04.054340+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:04.054340+0000","last_undegraded":"2024-04-15T23:38:04.054340+0000","last_fullsized":"2024-04-15T23:38:04.054340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:54.676743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054295+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054295+0000","last_peered":"2024-04-15T23:38:04.054295+0000","last_clean":"2024-04-15T23:38:04.054295+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054295+0000","last_undegraded":"2024-04-15T23:38:04.054295+0000","last_fullsized":"2024-04-15T23:38:04.054295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055405+0000","last_change":"2024-04-15T23:37:54.980092+0000","last_active":"2024-04-15T23:38:04.055405+0000","last_peered":"2024-04-15T23:38:04.055405+0000","last_clean":"2024-04-15T23:38:04.055405+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:04.055405+0000","last_undegraded":"2024-04-15T23:38:04.055405+0000","last_fullsized":"2024-04-15T23:38:04.055405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:57.488763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055369+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055369+0000","last_peered":"2024-04-15T23:38:04.055369+0000","last_clean":"2024-04-15T23:38:04.055369+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055369+0000","last_undegraded":"2024-04-15T23:38:04.055369+0000","last_fullsized":"2024-04-15T23:38:04.055369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:15:42.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":267,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151158+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151158+0000","last_peered":"2024-04-15T23:38:04.151158+0000","last_clean":"2024-04-15T23:38:04.151158+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151158+0000","last_undegraded":"2024-04-15T23:38:04.151158+0000","last_fullsized":"2024-04-15T23:38:04.151158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:08.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055032+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055032+0000","last_peered":"2024-04-15T23:38:04.055032+0000","last_clean":"2024-04-15T23:38:04.055032+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055032+0000","last_undegraded":"2024-04-15T23:38:04.055032+0000","last_fullsized":"2024-04-15T23:38:04.055032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:56.957050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054430+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:38:04.054430+0000","last_peered":"2024-04-15T23:38:04.054430+0000","last_clean":"2024-04-15T23:38:04.054430+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:04.054430+0000","last_undegraded":"2024-04-15T23:38:04.054430+0000","last_fullsized":"2024-04-15T23:38:04.054430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054605+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054605+0000","last_peered":"2024-04-15T23:38:04.054605+0000","last_clean":"2024-04-15T23:38:04.054605+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054605+0000","last_undegraded":"2024-04-15T23:38:04.054605+0000","last_fullsized":"2024-04-15T23:38:04.054605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:42:47.190183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054713+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054713+0000","last_peered":"2024-04-15T23:38:04.054713+0000","last_clean":"2024-04-15T23:38:04.054713+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054713+0000","last_undegraded":"2024-04-15T23:38:04.054713+0000","last_fullsized":"2024-04-15T23:38:04.054713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150050+0000","last_change":"2024-04-15T23:37:54.979663+0000","last_active":"2024-04-15T23:38:04.150050+0000","last_peered":"2024-04-15T23:38:04.150050+0000","last_clean":"2024-04-15T23:38:04.150050+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:04.150050+0000","last_undegraded":"2024-04-15T23:38:04.150050+0000","last_fullsized":"2024-04-15T23:38:04.150050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:16:39.846762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150353+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150353+0000","last_peered":"2024-04-15T23:38:04.150353+0000","last_clean":"2024-04-15T23:38:04.150353+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150353+0000","last_undegraded":"2024-04-15T23:38:04.150353+0000","last_fullsized":"2024-04-15T23:38:04.150353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:45:18.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055118+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055118+0000","last_peered":"2024-04-15T23:38:04.055118+0000","last_clean":"2024-04-15T23:38:04.055118+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055118+0000","last_undegraded":"2024-04-15T23:38:04.055118+0000","last_fullsized":"2024-04-15T23:38:04.055118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054459+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054459+0000","last_peered":"2024-04-15T23:38:04.054459+0000","last_clean":"2024-04-15T23:38:04.054459+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054459+0000","last_undegraded":"2024-04-15T23:38:04.054459+0000","last_fullsized":"2024-04-15T23:38:04.054459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:48.663512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":309,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.970465+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:21.553276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054650+0000","last_change":"2024-04-15T23:37:54.975024+0000","last_active":"2024-04-15T23:38:04.054650+0000","last_peered":"2024-04-15T23:38:04.054650+0000","last_clean":"2024-04-15T23:38:04.054650+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:04.054650+0000","last_undegraded":"2024-04-15T23:38:04.054650+0000","last_fullsized":"2024-04-15T23:38:04.054650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:07:57.085578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055211+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055211+0000","last_peered":"2024-04-15T23:38:04.055211+0000","last_clean":"2024-04-15T23:38:04.055211+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055211+0000","last_undegraded":"2024-04-15T23:38:04.055211+0000","last_fullsized":"2024-04-15T23:38:04.055211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:45.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150030+0000","last_change":"2024-04-15T23:37:54.980128+0000","last_active":"2024-04-15T23:38:04.150030+0000","last_peered":"2024-04-15T23:38:04.150030+0000","last_clean":"2024-04-15T23:38:04.150030+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:04.150030+0000","last_undegraded":"2024-04-15T23:38:04.150030+0000","last_fullsized":"2024-04-15T23:38:04.150030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:26:41.575192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151238+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151238+0000","last_peered":"2024-04-15T23:38:04.151238+0000","last_clean":"2024-04-15T23:38:04.151238+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151238+0000","last_undegraded":"2024-04-15T23:38:04.151238+0000","last_fullsized":"2024-04-15T23:38:04.151238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:43.826554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":303,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054304+0000","last_change":"2024-04-15T23:37:54.980087+0000","last_active":"2024-04-15T23:38:04.054304+0000","last_peered":"2024-04-15T23:38:04.054304+0000","last_clean":"2024-04-15T23:38:04.054304+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:04.054304+0000","last_undegraded":"2024-04-15T23:38:04.054304+0000","last_fullsized":"2024-04-15T23:38:04.054304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:40:49.638064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055338+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:04.055338+0000","last_peered":"2024-04-15T23:38:04.055338+0000","last_clean":"2024-04-15T23:38:04.055338+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:04.055338+0000","last_undegraded":"2024-04-15T23:38:04.055338+0000","last_fullsized":"2024-04-15T23:38:04.055338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:57.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":566,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054387+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054387+0000","last_peered":"2024-04-15T23:38:04.054387+0000","last_clean":"2024-04-15T23:38:04.054387+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054387+0000","last_undegraded":"2024-04-15T23:38:04.054387+0000","last_fullsized":"2024-04-15T23:38:04.054387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150879+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.150879+0000","last_peered":"2024-04-15T23:38:04.150879+0000","last_clean":"2024-04-15T23:38:04.150879+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.150879+0000","last_undegraded":"2024-04-15T23:38:04.150879+0000","last_fullsized":"2024-04-15T23:38:04.150879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:38:27.066961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151007+0000","last_change":"2024-04-15T23:37:54.975622+0000","last_active":"2024-04-15T23:38:04.151007+0000","last_peered":"2024-04-15T23:38:04.151007+0000","last_clean":"2024-04-15T23:38:04.151007+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:04.151007+0000","last_undegraded":"2024-04-15T23:38:04.151007+0000","last_fullsized":"2024-04-15T23:38:04.151007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:17:12.523528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150683+0000","last_change":"2024-04-15T23:37:54.974738+0000","last_active":"2024-04-15T23:38:04.150683+0000","last_peered":"2024-04-15T23:38:04.150683+0000","last_clean":"2024-04-15T23:38:04.150683+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:04.150683+0000","last_undegraded":"2024-04-15T23:38:04.150683+0000","last_fullsized":"2024-04-15T23:38:04.150683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:41:17.825004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055234+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055234+0000","last_peered":"2024-04-15T23:38:04.055234+0000","last_clean":"2024-04-15T23:38:04.055234+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055234+0000","last_undegraded":"2024-04-15T23:38:04.055234+0000","last_fullsized":"2024-04-15T23:38:04.055234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:50:08.878782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054981+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.054981+0000","last_peered":"2024-04-15T23:38:04.054981+0000","last_clean":"2024-04-15T23:38:04.054981+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.054981+0000","last_undegraded":"2024-04-15T23:38:04.054981+0000","last_fullsized":"2024-04-15T23:38:04.054981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:46:16.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150966+0000","last_change":"2024-04-15T23:37:54.975504+0000","last_active":"2024-04-15T23:38:04.150966+0000","last_peered":"2024-04-15T23:38:04.150966+0000","last_clean":"2024-04-15T23:38:04.150966+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:04.150966+0000","last_undegraded":"2024-04-15T23:38:04.150966+0000","last_fullsized":"2024-04-15T23:38:04.150966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:54:46.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150389+0000","last_change":"2024-04-15T23:37:54.974969+0000","last_active":"2024-04-15T23:38:04.150389+0000","last_peered":"2024-04-15T23:38:04.150389+0000","last_clean":"2024-04-15T23:38:04.150389+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:04.150389+0000","last_undegraded":"2024-04-15T23:38:04.150389+0000","last_fullsized":"2024-04-15T23:38:04.150389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:24.991458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150768+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150768+0000","last_peered":"2024-04-15T23:38:04.150768+0000","last_clean":"2024-04-15T23:38:04.150768+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150768+0000","last_undegraded":"2024-04-15T23:38:04.150768+0000","last_fullsized":"2024-04-15T23:38:04.150768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:45:24.736666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054719+0000","last_change":"2024-04-15T23:37:54.975484+0000","last_active":"2024-04-15T23:38:04.054719+0000","last_peered":"2024-04-15T23:38:04.054719+0000","last_clean":"2024-04-15T23:38:04.054719+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:04.054719+0000","last_undegraded":"2024-04-15T23:38:04.054719+0000","last_fullsized":"2024-04-15T23:38:04.054719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:35.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151067+0000","last_change":"2024-04-15T23:37:54.979558+0000","last_active":"2024-04-15T23:38:04.151067+0000","last_peered":"2024-04-15T23:38:04.151067+0000","last_clean":"2024-04-15T23:38:04.151067+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:04.151067+0000","last_undegraded":"2024-04-15T23:38:04.151067+0000","last_fullsized":"2024-04-15T23:38:04.151067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:34:18.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054445+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054445+0000","last_peered":"2024-04-15T23:38:04.054445+0000","last_clean":"2024-04-15T23:38:04.054445+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054445+0000","last_undegraded":"2024-04-15T23:38:04.054445+0000","last_fullsized":"2024-04-15T23:38:04.054445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055602+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:38:04.055602+0000","last_peered":"2024-04-15T23:38:04.055602+0000","last_clean":"2024-04-15T23:38:04.055602+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:04.055602+0000","last_undegraded":"2024-04-15T23:38:04.055602+0000","last_fullsized":"2024-04-15T23:38:04.055602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.149931+0000","last_change":"2024-04-15T23:37:54.980406+0000","last_active":"2024-04-15T23:38:04.149931+0000","last_peered":"2024-04-15T23:38:04.149931+0000","last_clean":"2024-04-15T23:38:04.149931+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:04.149931+0000","last_undegraded":"2024-04-15T23:38:04.149931+0000","last_fullsized":"2024-04-15T23:38:04.149931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:06.260508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150220+0000","last_change":"2024-04-15T23:37:54.975952+0000","last_active":"2024-04-15T23:38:04.150220+0000","last_peered":"2024-04-15T23:38:04.150220+0000","last_clean":"2024-04-15T23:38:04.150220+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:04.150220+0000","last_undegraded":"2024-04-15T23:38:04.150220+0000","last_fullsized":"2024-04-15T23:38:04.150220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:11.183075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054759+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054759+0000","last_peered":"2024-04-15T23:38:04.054759+0000","last_clean":"2024-04-15T23:38:04.054759+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054759+0000","last_undegraded":"2024-04-15T23:38:04.054759+0000","last_fullsized":"2024-04-15T23:38:04.054759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151039+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151039+0000","last_peered":"2024-04-15T23:38:04.151039+0000","last_clean":"2024-04-15T23:38:04.151039+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151039+0000","last_undegraded":"2024-04-15T23:38:04.151039+0000","last_fullsized":"2024-04-15T23:38:04.151039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:20:33.862210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150243+0000","last_change":"2024-04-15T23:37:54.980322+0000","last_active":"2024-04-15T23:38:04.150243+0000","last_peered":"2024-04-15T23:38:04.150243+0000","last_clean":"2024-04-15T23:38:04.150243+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:04.150243+0000","last_undegraded":"2024-04-15T23:38:04.150243+0000","last_fullsized":"2024-04-15T23:38:04.150243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:04:30.063643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054307+0000","last_change":"2024-04-15T23:37:54.969392+0000","last_active":"2024-04-15T23:38:04.054307+0000","last_peered":"2024-04-15T23:38:04.054307+0000","last_clean":"2024-04-15T23:38:04.054307+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:04.054307+0000","last_undegraded":"2024-04-15T23:38:04.054307+0000","last_fullsized":"2024-04-15T23:38:04.054307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:34.602096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055197+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:38:04.055197+0000","last_peered":"2024-04-15T23:38:04.055197+0000","last_clean":"2024-04-15T23:38:04.055197+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:04.055197+0000","last_undegraded":"2024-04-15T23:38:04.055197+0000","last_fullsized":"2024-04-15T23:38:04.055197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054520+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054520+0000","last_peered":"2024-04-15T23:38:04.054520+0000","last_clean":"2024-04-15T23:38:04.054520+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054520+0000","last_undegraded":"2024-04-15T23:38:04.054520+0000","last_fullsized":"2024-04-15T23:38:04.054520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":208,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054569+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.054569+0000","last_peered":"2024-04-15T23:38:04.054569+0000","last_clean":"2024-04-15T23:38:04.054569+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:04.054569+0000","last_undegraded":"2024-04-15T23:38:04.054569+0000","last_fullsized":"2024-04-15T23:38:04.054569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:00:37.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055575+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:38:04.055575+0000","last_peered":"2024-04-15T23:38:04.055575+0000","last_clean":"2024-04-15T23:38:04.055575+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:04.055575+0000","last_undegraded":"2024-04-15T23:38:04.055575+0000","last_fullsized":"2024-04-15T23:38:04.055575+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150089+0000","last_change":"2024-04-15T23:37:54.974977+0000","last_active":"2024-04-15T23:38:04.150089+0000","last_peered":"2024-04-15T23:38:04.150089+0000","last_clean":"2024-04-15T23:38:04.150089+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:04.150089+0000","last_undegraded":"2024-04-15T23:38:04.150089+0000","last_fullsized":"2024-04-15T23:38:04.150089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:17:35.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150304+0000","last_change":"2024-04-15T23:37:54.976495+0000","last_active":"2024-04-15T23:38:04.150304+0000","last_peered":"2024-04-15T23:38:04.150304+0000","last_clean":"2024-04-15T23:38:04.150304+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:04.150304+0000","last_undegraded":"2024-04-15T23:38:04.150304+0000","last_fullsized":"2024-04-15T23:38:04.150304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:22:39.677169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054628+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:38:04.054628+0000","last_peered":"2024-04-15T23:38:04.054628+0000","last_clean":"2024-04-15T23:38:04.054628+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:04.054628+0000","last_undegraded":"2024-04-15T23:38:04.054628+0000","last_fullsized":"2024-04-15T23:38:04.054628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150576+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150576+0000","last_peered":"2024-04-15T23:38:04.150576+0000","last_clean":"2024-04-15T23:38:04.150576+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150576+0000","last_undegraded":"2024-04-15T23:38:04.150576+0000","last_fullsized":"2024-04-15T23:38:04.150576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:04:50.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054602+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054602+0000","last_peered":"2024-04-15T23:38:04.054602+0000","last_clean":"2024-04-15T23:38:04.054602+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054602+0000","last_undegraded":"2024-04-15T23:38:04.054602+0000","last_fullsized":"2024-04-15T23:38:04.054602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":361,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054539+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054539+0000","last_peered":"2024-04-15T23:38:04.054539+0000","last_clean":"2024-04-15T23:38:04.054539+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054539+0000","last_undegraded":"2024-04-15T23:38:04.054539+0000","last_fullsized":"2024-04-15T23:38:04.054539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:22.640720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055329+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:38:04.055329+0000","last_peered":"2024-04-15T23:38:04.055329+0000","last_clean":"2024-04-15T23:38:04.055329+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:04.055329+0000","last_undegraded":"2024-04-15T23:38:04.055329+0000","last_fullsized":"2024-04-15T23:38:04.055329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:37:54.980855+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:03.374439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055280+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055280+0000","last_peered":"2024-04-15T23:38:04.055280+0000","last_clean":"2024-04-15T23:38:04.055280+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055280+0000","last_undegraded":"2024-04-15T23:38:04.055280+0000","last_fullsized":"2024-04-15T23:38:04.055280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055018+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055018+0000","last_peered":"2024-04-15T23:38:04.055018+0000","last_clean":"2024-04-15T23:38:04.055018+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055018+0000","last_undegraded":"2024-04-15T23:38:04.055018+0000","last_fullsized":"2024-04-15T23:38:04.055018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055007+0000","last_change":"2024-04-15T23:37:54.969099+0000","last_active":"2024-04-15T23:38:04.055007+0000","last_peered":"2024-04-15T23:38:04.055007+0000","last_clean":"2024-04-15T23:38:04.055007+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:04.055007+0000","last_undegraded":"2024-04-15T23:38:04.055007+0000","last_fullsized":"2024-04-15T23:38:04.055007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:33:24.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150996+0000","last_change":"2024-04-15T23:37:54.977549+0000","last_active":"2024-04-15T23:38:04.150996+0000","last_peered":"2024-04-15T23:38:04.150996+0000","last_clean":"2024-04-15T23:38:04.150996+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:04.150996+0000","last_undegraded":"2024-04-15T23:38:04.150996+0000","last_fullsized":"2024-04-15T23:38:04.150996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:20:29.898627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054388+0000","last_change":"2024-04-15T23:37:54.983847+0000","last_active":"2024-04-15T23:38:04.054388+0000","last_peered":"2024-04-15T23:38:04.054388+0000","last_clean":"2024-04-15T23:38:04.054388+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:04.054388+0000","last_undegraded":"2024-04-15T23:38:04.054388+0000","last_fullsized":"2024-04-15T23:38:04.054388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:08:01.568734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150777+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150777+0000","last_peered":"2024-04-15T23:38:04.150777+0000","last_clean":"2024-04-15T23:38:04.150777+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150777+0000","last_undegraded":"2024-04-15T23:38:04.150777+0000","last_fullsized":"2024-04-15T23:38:04.150777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:56.623760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150376+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150376+0000","last_peered":"2024-04-15T23:38:04.150376+0000","last_clean":"2024-04-15T23:38:04.150376+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150376+0000","last_undegraded":"2024-04-15T23:38:04.150376+0000","last_fullsized":"2024-04-15T23:38:04.150376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:57:32.784527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":174,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:54:03.314247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150917+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150917+0000","last_peered":"2024-04-15T23:38:04.150917+0000","last_clean":"2024-04-15T23:38:04.150917+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150917+0000","last_undegraded":"2024-04-15T23:38:04.150917+0000","last_fullsized":"2024-04-15T23:38:04.150917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:42.892541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054473+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054473+0000","last_peered":"2024-04-15T23:38:04.054473+0000","last_clean":"2024-04-15T23:38:04.054473+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054473+0000","last_undegraded":"2024-04-15T23:38:04.054473+0000","last_fullsized":"2024-04-15T23:38:04.054473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:20:23.720332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055487+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.055487+0000","last_peered":"2024-04-15T23:38:04.055487+0000","last_clean":"2024-04-15T23:38:04.055487+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:04.055487+0000","last_undegraded":"2024-04-15T23:38:04.055487+0000","last_fullsized":"2024-04-15T23:38:04.055487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:11:04.686698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054313+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:38:04.054313+0000","last_peered":"2024-04-15T23:38:04.054313+0000","last_clean":"2024-04-15T23:38:04.054313+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:04.054313+0000","last_undegraded":"2024-04-15T23:38:04.054313+0000","last_fullsized":"2024-04-15T23:38:04.054313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055521+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055521+0000","last_peered":"2024-04-15T23:38:04.055521+0000","last_clean":"2024-04-15T23:38:04.055521+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055521+0000","last_undegraded":"2024-04-15T23:38:04.055521+0000","last_fullsized":"2024-04-15T23:38:04.055521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:37:38.502349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054157+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054157+0000","last_peered":"2024-04-15T23:38:04.054157+0000","last_clean":"2024-04-15T23:38:04.054157+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054157+0000","last_undegraded":"2024-04-15T23:38:04.054157+0000","last_fullsized":"2024-04-15T23:38:04.054157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":272,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:09.331923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054226+0000","last_change":"2024-04-15T23:37:54.969689+0000","last_active":"2024-04-15T23:38:04.054226+0000","last_peered":"2024-04-15T23:38:04.054226+0000","last_clean":"2024-04-15T23:38:04.054226+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:04.054226+0000","last_undegraded":"2024-04-15T23:38:04.054226+0000","last_fullsized":"2024-04-15T23:38:04.054226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:16:27.272034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054836+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054836+0000","last_peered":"2024-04-15T23:38:04.054836+0000","last_clean":"2024-04-15T23:38:04.054836+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054836+0000","last_undegraded":"2024-04-15T23:38:04.054836+0000","last_fullsized":"2024-04-15T23:38:04.054836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:37:11.947230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054669+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054669+0000","last_peered":"2024-04-15T23:38:04.054669+0000","last_clean":"2024-04-15T23:38:04.054669+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054669+0000","last_undegraded":"2024-04-15T23:38:04.054669+0000","last_fullsized":"2024-04-15T23:38:04.054669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054921+0000","last_change":"2024-04-15T23:37:54.983724+0000","last_active":"2024-04-15T23:38:04.054921+0000","last_peered":"2024-04-15T23:38:04.054921+0000","last_clean":"2024-04-15T23:38:04.054921+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:04.054921+0000","last_undegraded":"2024-04-15T23:38:04.054921+0000","last_fullsized":"2024-04-15T23:38:04.054921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:09.088379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":517,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150652+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150652+0000","last_peered":"2024-04-15T23:38:04.150652+0000","last_clean":"2024-04-15T23:38:04.150652+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150652+0000","last_undegraded":"2024-04-15T23:38:04.150652+0000","last_fullsized":"2024-04-15T23:38:04.150652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:01:49.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150486+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150486+0000","last_peered":"2024-04-15T23:38:04.150486+0000","last_clean":"2024-04-15T23:38:04.150486+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150486+0000","last_undegraded":"2024-04-15T23:38:04.150486+0000","last_fullsized":"2024-04-15T23:38:04.150486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:12.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150392+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150392+0000","last_peered":"2024-04-15T23:38:04.150392+0000","last_clean":"2024-04-15T23:38:04.150392+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150392+0000","last_undegraded":"2024-04-15T23:38:04.150392+0000","last_fullsized":"2024-04-15T23:38:04.150392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:10.597065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":210,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055160+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055160+0000","last_peered":"2024-04-15T23:38:04.055160+0000","last_clean":"2024-04-15T23:38:04.055160+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055160+0000","last_undegraded":"2024-04-15T23:38:04.055160+0000","last_fullsized":"2024-04-15T23:38:04.055160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:42.810034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054783+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054783+0000","last_peered":"2024-04-15T23:38:04.054783+0000","last_clean":"2024-04-15T23:38:04.054783+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054783+0000","last_undegraded":"2024-04-15T23:38:04.054783+0000","last_fullsized":"2024-04-15T23:38:04.054783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055412+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055412+0000","last_peered":"2024-04-15T23:38:04.055412+0000","last_clean":"2024-04-15T23:38:04.055412+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055412+0000","last_undegraded":"2024-04-15T23:38:04.055412+0000","last_fullsized":"2024-04-15T23:38:04.055412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":577,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150501+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150501+0000","last_peered":"2024-04-15T23:38:04.150501+0000","last_clean":"2024-04-15T23:38:04.150501+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150501+0000","last_undegraded":"2024-04-15T23:38:04.150501+0000","last_fullsized":"2024-04-15T23:38:04.150501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:42:50.642806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055152+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055152+0000","last_peered":"2024-04-15T23:38:04.055152+0000","last_clean":"2024-04-15T23:38:04.055152+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055152+0000","last_undegraded":"2024-04-15T23:38:04.055152+0000","last_fullsized":"2024-04-15T23:38:04.055152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:35:47.730630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103206,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85412,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286428,"statfs":{"total":96636764160,"available":96549302272,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80980,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290860,"statfs":{"total":96636764160,"available":96553840640,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88936,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282904,"statfs":{"total":96636764160,"available":96545693696,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:08.199 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-15T23:38:08.199 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:08.527 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:08.529 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:08.537 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-04-15T23:38:07.881907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255328,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860192,"statfs":{"total":289910292480,"available":289648836608,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001200"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055400+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:38:04.055400+0000","last_peered":"2024-04-15T23:38:04.055400+0000","last_clean":"2024-04-15T23:38:04.055400+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:04.055400+0000","last_undegraded":"2024-04-15T23:38:04.055400+0000","last_fullsized":"2024-04-15T23:38:04.055400+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055039+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:38:04.055039+0000","last_peered":"2024-04-15T23:38:04.055039+0000","last_clean":"2024-04-15T23:38:04.055039+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:04.055039+0000","last_undegraded":"2024-04-15T23:38:04.055039+0000","last_fullsized":"2024-04-15T23:38:04.055039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151265+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151265+0000","last_peered":"2024-04-15T23:38:04.151265+0000","last_clean":"2024-04-15T23:38:04.151265+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151265+0000","last_undegraded":"2024-04-15T23:38:04.151265+0000","last_fullsized":"2024-04-15T23:38:04.151265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:18:46.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":446,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150655+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150655+0000","last_peered":"2024-04-15T23:38:04.150655+0000","last_clean":"2024-04-15T23:38:04.150655+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150655+0000","last_undegraded":"2024-04-15T23:38:04.150655+0000","last_fullsized":"2024-04-15T23:38:04.150655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:06:46.388157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150937+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.150937+0000","last_peered":"2024-04-15T23:38:04.150937+0000","last_clean":"2024-04-15T23:38:04.150937+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.150937+0000","last_undegraded":"2024-04-15T23:38:04.150937+0000","last_fullsized":"2024-04-15T23:38:04.150937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:49:46.849666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:57.967361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":461,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150156+0000","last_change":"2024-04-15T23:37:54.979553+0000","last_active":"2024-04-15T23:38:04.150156+0000","last_peered":"2024-04-15T23:38:04.150156+0000","last_clean":"2024-04-15T23:38:04.150156+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:04.150156+0000","last_undegraded":"2024-04-15T23:38:04.150156+0000","last_fullsized":"2024-04-15T23:38:04.150156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:10:07.716446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055404+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:38:04.055404+0000","last_peered":"2024-04-15T23:38:04.055404+0000","last_clean":"2024-04-15T23:38:04.055404+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:04.055404+0000","last_undegraded":"2024-04-15T23:38:04.055404+0000","last_fullsized":"2024-04-15T23:38:04.055404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055091+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:38:04.055091+0000","last_peered":"2024-04-15T23:38:04.055091+0000","last_clean":"2024-04-15T23:38:04.055091+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:04.055091+0000","last_undegraded":"2024-04-15T23:38:04.055091+0000","last_fullsized":"2024-04-15T23:38:04.055091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":495,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151157+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151157+0000","last_peered":"2024-04-15T23:38:04.151157+0000","last_clean":"2024-04-15T23:38:04.151157+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151157+0000","last_undegraded":"2024-04-15T23:38:04.151157+0000","last_fullsized":"2024-04-15T23:38:04.151157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:44.888221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:37:54.980913+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:05.402863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":462,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054625+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:38:04.054625+0000","last_peered":"2024-04-15T23:38:04.054625+0000","last_clean":"2024-04-15T23:38:04.054625+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:04.054625+0000","last_undegraded":"2024-04-15T23:38:04.054625+0000","last_fullsized":"2024-04-15T23:38:04.054625+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":288,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150828+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150828+0000","last_peered":"2024-04-15T23:38:04.150828+0000","last_clean":"2024-04-15T23:38:04.150828+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150828+0000","last_undegraded":"2024-04-15T23:38:04.150828+0000","last_fullsized":"2024-04-15T23:38:04.150828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:13:18.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150330+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150330+0000","last_peered":"2024-04-15T23:38:04.150330+0000","last_clean":"2024-04-15T23:38:04.150330+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150330+0000","last_undegraded":"2024-04-15T23:38:04.150330+0000","last_fullsized":"2024-04-15T23:38:04.150330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:29:51.531478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":547,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150536+0000","last_change":"2024-04-15T23:37:54.977342+0000","last_active":"2024-04-15T23:38:04.150536+0000","last_peered":"2024-04-15T23:38:04.150536+0000","last_clean":"2024-04-15T23:38:04.150536+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:04.150536+0000","last_undegraded":"2024-04-15T23:38:04.150536+0000","last_fullsized":"2024-04-15T23:38:04.150536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:08:13.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055354+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:38:04.055354+0000","last_peered":"2024-04-15T23:38:04.055354+0000","last_clean":"2024-04-15T23:38:04.055354+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:04.055354+0000","last_undegraded":"2024-04-15T23:38:04.055354+0000","last_fullsized":"2024-04-15T23:38:04.055354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055324+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:38:04.055324+0000","last_peered":"2024-04-15T23:38:04.055324+0000","last_clean":"2024-04-15T23:38:04.055324+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:04.055324+0000","last_undegraded":"2024-04-15T23:38:04.055324+0000","last_fullsized":"2024-04-15T23:38:04.055324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":252,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054942+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:38:04.054942+0000","last_peered":"2024-04-15T23:38:04.054942+0000","last_clean":"2024-04-15T23:38:04.054942+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:04.054942+0000","last_undegraded":"2024-04-15T23:38:04.054942+0000","last_fullsized":"2024-04-15T23:38:04.054942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150860+0000","last_change":"2024-04-15T23:37:54.974826+0000","last_active":"2024-04-15T23:38:04.150860+0000","last_peered":"2024-04-15T23:38:04.150860+0000","last_clean":"2024-04-15T23:38:04.150860+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:04.150860+0000","last_undegraded":"2024-04-15T23:38:04.150860+0000","last_fullsized":"2024-04-15T23:38:04.150860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:36.179704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":516,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151233+0000","last_change":"2024-04-15T23:37:54.975373+0000","last_active":"2024-04-15T23:38:04.151233+0000","last_peered":"2024-04-15T23:38:04.151233+0000","last_clean":"2024-04-15T23:38:04.151233+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:04.151233+0000","last_undegraded":"2024-04-15T23:38:04.151233+0000","last_fullsized":"2024-04-15T23:38:04.151233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:44.503479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054482+0000","last_change":"2024-04-15T23:37:54.984078+0000","last_active":"2024-04-15T23:38:04.054482+0000","last_peered":"2024-04-15T23:38:04.054482+0000","last_clean":"2024-04-15T23:38:04.054482+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:04.054482+0000","last_undegraded":"2024-04-15T23:38:04.054482+0000","last_fullsized":"2024-04-15T23:38:04.054482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:04:28.242880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054340+0000","last_change":"2024-04-15T23:37:54.970987+0000","last_active":"2024-04-15T23:38:04.054340+0000","last_peered":"2024-04-15T23:38:04.054340+0000","last_clean":"2024-04-15T23:38:04.054340+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:04.054340+0000","last_undegraded":"2024-04-15T23:38:04.054340+0000","last_fullsized":"2024-04-15T23:38:04.054340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:54.676743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054295+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054295+0000","last_peered":"2024-04-15T23:38:04.054295+0000","last_clean":"2024-04-15T23:38:04.054295+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054295+0000","last_undegraded":"2024-04-15T23:38:04.054295+0000","last_fullsized":"2024-04-15T23:38:04.054295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055405+0000","last_change":"2024-04-15T23:37:54.980092+0000","last_active":"2024-04-15T23:38:04.055405+0000","last_peered":"2024-04-15T23:38:04.055405+0000","last_clean":"2024-04-15T23:38:04.055405+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:04.055405+0000","last_undegraded":"2024-04-15T23:38:04.055405+0000","last_fullsized":"2024-04-15T23:38:04.055405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:57.488763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055369+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055369+0000","last_peered":"2024-04-15T23:38:04.055369+0000","last_clean":"2024-04-15T23:38:04.055369+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055369+0000","last_undegraded":"2024-04-15T23:38:04.055369+0000","last_fullsized":"2024-04-15T23:38:04.055369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:15:42.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":267,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151158+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151158+0000","last_peered":"2024-04-15T23:38:04.151158+0000","last_clean":"2024-04-15T23:38:04.151158+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151158+0000","last_undegraded":"2024-04-15T23:38:04.151158+0000","last_fullsized":"2024-04-15T23:38:04.151158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:08.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055032+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055032+0000","last_peered":"2024-04-15T23:38:04.055032+0000","last_clean":"2024-04-15T23:38:04.055032+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055032+0000","last_undegraded":"2024-04-15T23:38:04.055032+0000","last_fullsized":"2024-04-15T23:38:04.055032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:56.957050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054430+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:38:04.054430+0000","last_peered":"2024-04-15T23:38:04.054430+0000","last_clean":"2024-04-15T23:38:04.054430+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:04.054430+0000","last_undegraded":"2024-04-15T23:38:04.054430+0000","last_fullsized":"2024-04-15T23:38:04.054430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054605+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054605+0000","last_peered":"2024-04-15T23:38:04.054605+0000","last_clean":"2024-04-15T23:38:04.054605+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054605+0000","last_undegraded":"2024-04-15T23:38:04.054605+0000","last_fullsized":"2024-04-15T23:38:04.054605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:42:47.190183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054713+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054713+0000","last_peered":"2024-04-15T23:38:04.054713+0000","last_clean":"2024-04-15T23:38:04.054713+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054713+0000","last_undegraded":"2024-04-15T23:38:04.054713+0000","last_fullsized":"2024-04-15T23:38:04.054713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150050+0000","last_change":"2024-04-15T23:37:54.979663+0000","last_active":"2024-04-15T23:38:04.150050+0000","last_peered":"2024-04-15T23:38:04.150050+0000","last_clean":"2024-04-15T23:38:04.150050+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:04.150050+0000","last_undegraded":"2024-04-15T23:38:04.150050+0000","last_fullsized":"2024-04-15T23:38:04.150050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:16:39.846762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150353+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150353+0000","last_peered":"2024-04-15T23:38:04.150353+0000","last_clean":"2024-04-15T23:38:04.150353+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150353+0000","last_undegraded":"2024-04-15T23:38:04.150353+0000","last_fullsized":"2024-04-15T23:38:04.150353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:45:18.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055118+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055118+0000","last_peered":"2024-04-15T23:38:04.055118+0000","last_clean":"2024-04-15T23:38:04.055118+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055118+0000","last_undegraded":"2024-04-15T23:38:04.055118+0000","last_fullsized":"2024-04-15T23:38:04.055118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054459+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054459+0000","last_peered":"2024-04-15T23:38:04.054459+0000","last_clean":"2024-04-15T23:38:04.054459+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054459+0000","last_undegraded":"2024-04-15T23:38:04.054459+0000","last_fullsized":"2024-04-15T23:38:04.054459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:48.663512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":309,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.970465+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:21.553276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054650+0000","last_change":"2024-04-15T23:37:54.975024+0000","last_active":"2024-04-15T23:38:04.054650+0000","last_peered":"2024-04-15T23:38:04.054650+0000","last_clean":"2024-04-15T23:38:04.054650+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:04.054650+0000","last_undegraded":"2024-04-15T23:38:04.054650+0000","last_fullsized":"2024-04-15T23:38:04.054650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:07:57.085578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055211+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055211+0000","last_peered":"2024-04-15T23:38:04.055211+0000","last_clean":"2024-04-15T23:38:04.055211+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055211+0000","last_undegraded":"2024-04-15T23:38:04.055211+0000","last_fullsized":"2024-04-15T23:38:04.055211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:45.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150030+0000","last_change":"2024-04-15T23:37:54.980128+0000","last_active":"2024-04-15T23:38:04.150030+0000","last_peered":"2024-04-15T23:38:04.150030+0000","last_clean":"2024-04-15T23:38:04.150030+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:04.150030+0000","last_undegraded":"2024-04-15T23:38:04.150030+0000","last_fullsized":"2024-04-15T23:38:04.150030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:26:41.575192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151238+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151238+0000","last_peered":"2024-04-15T23:38:04.151238+0000","last_clean":"2024-04-15T23:38:04.151238+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151238+0000","last_undegraded":"2024-04-15T23:38:04.151238+0000","last_fullsized":"2024-04-15T23:38:04.151238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:43.826554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":303,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054304+0000","last_change":"2024-04-15T23:37:54.980087+0000","last_active":"2024-04-15T23:38:04.054304+0000","last_peered":"2024-04-15T23:38:04.054304+0000","last_clean":"2024-04-15T23:38:04.054304+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:04.054304+0000","last_undegraded":"2024-04-15T23:38:04.054304+0000","last_fullsized":"2024-04-15T23:38:04.054304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:40:49.638064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055338+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:04.055338+0000","last_peered":"2024-04-15T23:38:04.055338+0000","last_clean":"2024-04-15T23:38:04.055338+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:04.055338+0000","last_undegraded":"2024-04-15T23:38:04.055338+0000","last_fullsized":"2024-04-15T23:38:04.055338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:57.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":566,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054387+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054387+0000","last_peered":"2024-04-15T23:38:04.054387+0000","last_clean":"2024-04-15T23:38:04.054387+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054387+0000","last_undegraded":"2024-04-15T23:38:04.054387+0000","last_fullsized":"2024-04-15T23:38:04.054387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150879+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.150879+0000","last_peered":"2024-04-15T23:38:04.150879+0000","last_clean":"2024-04-15T23:38:04.150879+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.150879+0000","last_undegraded":"2024-04-15T23:38:04.150879+0000","last_fullsized":"2024-04-15T23:38:04.150879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:38:27.066961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151007+0000","last_change":"2024-04-15T23:37:54.975622+0000","last_active":"2024-04-15T23:38:04.151007+0000","last_peered":"2024-04-15T23:38:04.151007+0000","last_clean":"2024-04-15T23:38:04.151007+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:04.151007+0000","last_undegraded":"2024-04-15T23:38:04.151007+0000","last_fullsized":"2024-04-15T23:38:04.151007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:17:12.523528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150683+0000","last_change":"2024-04-15T23:37:54.974738+0000","last_active":"2024-04-15T23:38:04.150683+0000","last_peered":"2024-04-15T23:38:04.150683+0000","last_clean":"2024-04-15T23:38:04.150683+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:04.150683+0000","last_undegraded":"2024-04-15T23:38:04.150683+0000","last_fullsized":"2024-04-15T23:38:04.150683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:41:17.825004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055234+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055234+0000","last_peered":"2024-04-15T23:38:04.055234+0000","last_clean":"2024-04-15T23:38:04.055234+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055234+0000","last_undegraded":"2024-04-15T23:38:04.055234+0000","last_fullsized":"2024-04-15T23:38:04.055234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:50:08.878782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054981+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.054981+0000","last_peered":"2024-04-15T23:38:04.054981+0000","last_clean":"2024-04-15T23:38:04.054981+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.054981+0000","last_undegraded":"2024-04-15T23:38:04.054981+0000","last_fullsized":"2024-04-15T23:38:04.054981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:46:16.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150966+0000","last_change":"2024-04-15T23:37:54.975504+0000","last_active":"2024-04-15T23:38:04.150966+0000","last_peered":"2024-04-15T23:38:04.150966+0000","last_clean":"2024-04-15T23:38:04.150966+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:04.150966+0000","last_undegraded":"2024-04-15T23:38:04.150966+0000","last_fullsized":"2024-04-15T23:38:04.150966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:54:46.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150389+0000","last_change":"2024-04-15T23:37:54.974969+0000","last_active":"2024-04-15T23:38:04.150389+0000","last_peered":"2024-04-15T23:38:04.150389+0000","last_clean":"2024-04-15T23:38:04.150389+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:04.150389+0000","last_undegraded":"2024-04-15T23:38:04.150389+0000","last_fullsized":"2024-04-15T23:38:04.150389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:24.991458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150768+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150768+0000","last_peered":"2024-04-15T23:38:04.150768+0000","last_clean":"2024-04-15T23:38:04.150768+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150768+0000","last_undegraded":"2024-04-15T23:38:04.150768+0000","last_fullsized":"2024-04-15T23:38:04.150768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:45:24.736666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054719+0000","last_change":"2024-04-15T23:37:54.975484+0000","last_active":"2024-04-15T23:38:04.054719+0000","last_peered":"2024-04-15T23:38:04.054719+0000","last_clean":"2024-04-15T23:38:04.054719+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:04.054719+0000","last_undegraded":"2024-04-15T23:38:04.054719+0000","last_fullsized":"2024-04-15T23:38:04.054719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:35.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151067+0000","last_change":"2024-04-15T23:37:54.979558+0000","last_active":"2024-04-15T23:38:04.151067+0000","last_peered":"2024-04-15T23:38:04.151067+0000","last_clean":"2024-04-15T23:38:04.151067+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:04.151067+0000","last_undegraded":"2024-04-15T23:38:04.151067+0000","last_fullsized":"2024-04-15T23:38:04.151067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:34:18.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054445+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054445+0000","last_peered":"2024-04-15T23:38:04.054445+0000","last_clean":"2024-04-15T23:38:04.054445+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054445+0000","last_undegraded":"2024-04-15T23:38:04.054445+0000","last_fullsized":"2024-04-15T23:38:04.054445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055602+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:38:04.055602+0000","last_peered":"2024-04-15T23:38:04.055602+0000","last_clean":"2024-04-15T23:38:04.055602+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:04.055602+0000","last_undegraded":"2024-04-15T23:38:04.055602+0000","last_fullsized":"2024-04-15T23:38:04.055602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.149931+0000","last_change":"2024-04-15T23:37:54.980406+0000","last_active":"2024-04-15T23:38:04.149931+0000","last_peered":"2024-04-15T23:38:04.149931+0000","last_clean":"2024-04-15T23:38:04.149931+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:04.149931+0000","last_undegraded":"2024-04-15T23:38:04.149931+0000","last_fullsized":"2024-04-15T23:38:04.149931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:06.260508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150220+0000","last_change":"2024-04-15T23:37:54.975952+0000","last_active":"2024-04-15T23:38:04.150220+0000","last_peered":"2024-04-15T23:38:04.150220+0000","last_clean":"2024-04-15T23:38:04.150220+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:04.150220+0000","last_undegraded":"2024-04-15T23:38:04.150220+0000","last_fullsized":"2024-04-15T23:38:04.150220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:11.183075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054759+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054759+0000","last_peered":"2024-04-15T23:38:04.054759+0000","last_clean":"2024-04-15T23:38:04.054759+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054759+0000","last_undegraded":"2024-04-15T23:38:04.054759+0000","last_fullsized":"2024-04-15T23:38:04.054759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151039+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151039+0000","last_peered":"2024-04-15T23:38:04.151039+0000","last_clean":"2024-04-15T23:38:04.151039+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151039+0000","last_undegraded":"2024-04-15T23:38:04.151039+0000","last_fullsized":"2024-04-15T23:38:04.151039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:20:33.862210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150243+0000","last_change":"2024-04-15T23:37:54.980322+0000","last_active":"2024-04-15T23:38:04.150243+0000","last_peered":"2024-04-15T23:38:04.150243+0000","last_clean":"2024-04-15T23:38:04.150243+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:04.150243+0000","last_undegraded":"2024-04-15T23:38:04.150243+0000","last_fullsized":"2024-04-15T23:38:04.150243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:04:30.063643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054307+0000","last_change":"2024-04-15T23:37:54.969392+0000","last_active":"2024-04-15T23:38:04.054307+0000","last_peered":"2024-04-15T23:38:04.054307+0000","last_clean":"2024-04-15T23:38:04.054307+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:04.054307+0000","last_undegraded":"2024-04-15T23:38:04.054307+0000","last_fullsized":"2024-04-15T23:38:04.054307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:34.602096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055197+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:38:04.055197+0000","last_peered":"2024-04-15T23:38:04.055197+0000","last_clean":"2024-04-15T23:38:04.055197+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:04.055197+0000","last_undegraded":"2024-04-15T23:38:04.055197+0000","last_fullsized":"2024-04-15T23:38:04.055197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054520+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054520+0000","last_peered":"2024-04-15T23:38:04.054520+0000","last_clean":"2024-04-15T23:38:04.054520+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054520+0000","last_undegraded":"2024-04-15T23:38:04.054520+0000","last_fullsized":"2024-04-15T23:38:04.054520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":208,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054569+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.054569+0000","last_peered":"2024-04-15T23:38:04.054569+0000","last_clean":"2024-04-15T23:38:04.054569+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:04.054569+0000","last_undegraded":"2024-04-15T23:38:04.054569+0000","last_fullsized":"2024-04-15T23:38:04.054569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:00:37.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055575+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:38:04.055575+0000","last_peered":"2024-04-15T23:38:04.055575+0000","last_clean":"2024-04-15T23:38:04.055575+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:04.055575+0000","last_undegraded":"2024-04-15T23:38:04.055575+0000","last_fullsized":"2024-04-15T23:38:04.055575+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150089+0000","last_change":"2024-04-15T23:37:54.974977+0000","last_active":"2024-04-15T23:38:04.150089+0000","last_peered":"2024-04-15T23:38:04.150089+0000","last_clean":"2024-04-15T23:38:04.150089+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:04.150089+0000","last_undegraded":"2024-04-15T23:38:04.150089+0000","last_fullsized":"2024-04-15T23:38:04.150089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:17:35.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150304+0000","last_change":"2024-04-15T23:37:54.976495+0000","last_active":"2024-04-15T23:38:04.150304+0000","last_peered":"2024-04-15T23:38:04.150304+0000","last_clean":"2024-04-15T23:38:04.150304+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:04.150304+0000","last_undegraded":"2024-04-15T23:38:04.150304+0000","last_fullsized":"2024-04-15T23:38:04.150304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:22:39.677169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054628+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:38:04.054628+0000","last_peered":"2024-04-15T23:38:04.054628+0000","last_clean":"2024-04-15T23:38:04.054628+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:04.054628+0000","last_undegraded":"2024-04-15T23:38:04.054628+0000","last_fullsized":"2024-04-15T23:38:04.054628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150576+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150576+0000","last_peered":"2024-04-15T23:38:04.150576+0000","last_clean":"2024-04-15T23:38:04.150576+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150576+0000","last_undegraded":"2024-04-15T23:38:04.150576+0000","last_fullsized":"2024-04-15T23:38:04.150576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:04:50.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054602+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054602+0000","last_peered":"2024-04-15T23:38:04.054602+0000","last_clean":"2024-04-15T23:38:04.054602+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054602+0000","last_undegraded":"2024-04-15T23:38:04.054602+0000","last_fullsized":"2024-04-15T23:38:04.054602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":361,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054539+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054539+0000","last_peered":"2024-04-15T23:38:04.054539+0000","last_clean":"2024-04-15T23:38:04.054539+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054539+0000","last_undegraded":"2024-04-15T23:38:04.054539+0000","last_fullsized":"2024-04-15T23:38:04.054539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:22.640720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055329+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:38:04.055329+0000","last_peered":"2024-04-15T23:38:04.055329+0000","last_clean":"2024-04-15T23:38:04.055329+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:04.055329+0000","last_undegraded":"2024-04-15T23:38:04.055329+0000","last_fullsized":"2024-04-15T23:38:04.055329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:37:54.980855+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:03.374439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055280+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055280+0000","last_peered":"2024-04-15T23:38:04.055280+0000","last_clean":"2024-04-15T23:38:04.055280+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055280+0000","last_undegraded":"2024-04-15T23:38:04.055280+0000","last_fullsized":"2024-04-15T23:38:04.055280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055018+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055018+0000","last_peered":"2024-04-15T23:38:04.055018+0000","last_clean":"2024-04-15T23:38:04.055018+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055018+0000","last_undegraded":"2024-04-15T23:38:04.055018+0000","last_fullsized":"2024-04-15T23:38:04.055018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055007+0000","last_change":"2024-04-15T23:37:54.969099+0000","last_active":"2024-04-15T23:38:04.055007+0000","last_peered":"2024-04-15T23:38:04.055007+0000","last_clean":"2024-04-15T23:38:04.055007+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:04.055007+0000","last_undegraded":"2024-04-15T23:38:04.055007+0000","last_fullsized":"2024-04-15T23:38:04.055007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:33:24.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150996+0000","last_change":"2024-04-15T23:37:54.977549+0000","last_active":"2024-04-15T23:38:04.150996+0000","last_peered":"2024-04-15T23:38:04.150996+0000","last_clean":"2024-04-15T23:38:04.150996+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:04.150996+0000","last_undegraded":"2024-04-15T23:38:04.150996+0000","last_fullsized":"2024-04-15T23:38:04.150996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:20:29.898627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054388+0000","last_change":"2024-04-15T23:37:54.983847+0000","last_active":"2024-04-15T23:38:04.054388+0000","last_peered":"2024-04-15T23:38:04.054388+0000","last_clean":"2024-04-15T23:38:04.054388+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:04.054388+0000","last_undegraded":"2024-04-15T23:38:04.054388+0000","last_fullsized":"2024-04-15T23:38:04.054388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:08:01.568734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150777+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150777+0000","last_peered":"2024-04-15T23:38:04.150777+0000","last_clean":"2024-04-15T23:38:04.150777+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150777+0000","last_undegraded":"2024-04-15T23:38:04.150777+0000","last_fullsized":"2024-04-15T23:38:04.150777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:56.623760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150376+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150376+0000","last_peered":"2024-04-15T23:38:04.150376+0000","last_clean":"2024-04-15T23:38:04.150376+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150376+0000","last_undegraded":"2024-04-15T23:38:04.150376+0000","last_fullsized":"2024-04-15T23:38:04.150376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:57:32.784527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":174,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:54:03.314247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150917+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150917+0000","last_peered":"2024-04-15T23:38:04.150917+0000","last_clean":"2024-04-15T23:38:04.150917+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150917+0000","last_undegraded":"2024-04-15T23:38:04.150917+0000","last_fullsized":"2024-04-15T23:38:04.150917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:42.892541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054473+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054473+0000","last_peered":"2024-04-15T23:38:04.054473+0000","last_clean":"2024-04-15T23:38:04.054473+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054473+0000","last_undegraded":"2024-04-15T23:38:04.054473+0000","last_fullsized":"2024-04-15T23:38:04.054473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:20:23.720332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055487+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.055487+0000","last_peered":"2024-04-15T23:38:04.055487+0000","last_clean":"2024-04-15T23:38:04.055487+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:04.055487+0000","last_undegraded":"2024-04-15T23:38:04.055487+0000","last_fullsized":"2024-04-15T23:38:04.055487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:11:04.686698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054313+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:38:04.054313+0000","last_peered":"2024-04-15T23:38:04.054313+0000","last_clean":"2024-04-15T23:38:04.054313+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:04.054313+0000","last_undegraded":"2024-04-15T23:38:04.054313+0000","last_fullsized":"2024-04-15T23:38:04.054313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055521+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055521+0000","last_peered":"2024-04-15T23:38:04.055521+0000","last_clean":"2024-04-15T23:38:04.055521+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055521+0000","last_undegraded":"2024-04-15T23:38:04.055521+0000","last_fullsized":"2024-04-15T23:38:04.055521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:37:38.502349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054157+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054157+0000","last_peered":"2024-04-15T23:38:04.054157+0000","last_clean":"2024-04-15T23:38:04.054157+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054157+0000","last_undegraded":"2024-04-15T23:38:04.054157+0000","last_fullsized":"2024-04-15T23:38:04.054157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":272,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:09.331923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054226+0000","last_change":"2024-04-15T23:37:54.969689+0000","last_active":"2024-04-15T23:38:04.054226+0000","last_peered":"2024-04-15T23:38:04.054226+0000","last_clean":"2024-04-15T23:38:04.054226+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:04.054226+0000","last_undegraded":"2024-04-15T23:38:04.054226+0000","last_fullsized":"2024-04-15T23:38:04.054226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:16:27.272034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054836+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054836+0000","last_peered":"2024-04-15T23:38:04.054836+0000","last_clean":"2024-04-15T23:38:04.054836+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054836+0000","last_undegraded":"2024-04-15T23:38:04.054836+0000","last_fullsized":"2024-04-15T23:38:04.054836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:37:11.947230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054669+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054669+0000","last_peered":"2024-04-15T23:38:04.054669+0000","last_clean":"2024-04-15T23:38:04.054669+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054669+0000","last_undegraded":"2024-04-15T23:38:04.054669+0000","last_fullsized":"2024-04-15T23:38:04.054669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054921+0000","last_change":"2024-04-15T23:37:54.983724+0000","last_active":"2024-04-15T23:38:04.054921+0000","last_peered":"2024-04-15T23:38:04.054921+0000","last_clean":"2024-04-15T23:38:04.054921+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:04.054921+0000","last_undegraded":"2024-04-15T23:38:04.054921+0000","last_fullsized":"2024-04-15T23:38:04.054921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:09.088379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":517,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150652+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150652+0000","last_peered":"2024-04-15T23:38:04.150652+0000","last_clean":"2024-04-15T23:38:04.150652+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150652+0000","last_undegraded":"2024-04-15T23:38:04.150652+0000","last_fullsized":"2024-04-15T23:38:04.150652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:01:49.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150486+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150486+0000","last_peered":"2024-04-15T23:38:04.150486+0000","last_clean":"2024-04-15T23:38:04.150486+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150486+0000","last_undegraded":"2024-04-15T23:38:04.150486+0000","last_fullsized":"2024-04-15T23:38:04.150486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:12.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150392+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150392+0000","last_peered":"2024-04-15T23:38:04.150392+0000","last_clean":"2024-04-15T23:38:04.150392+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150392+0000","last_undegraded":"2024-04-15T23:38:04.150392+0000","last_fullsized":"2024-04-15T23:38:04.150392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:10.597065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":210,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055160+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055160+0000","last_peered":"2024-04-15T23:38:04.055160+0000","last_clean":"2024-04-15T23:38:04.055160+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055160+0000","last_undegraded":"2024-04-15T23:38:04.055160+0000","last_fullsized":"2024-04-15T23:38:04.055160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:42.810034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054783+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054783+0000","last_peered":"2024-04-15T23:38:04.054783+0000","last_clean":"2024-04-15T23:38:04.054783+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054783+0000","last_undegraded":"2024-04-15T23:38:04.054783+0000","last_fullsized":"2024-04-15T23:38:04.054783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055412+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055412+0000","last_peered":"2024-04-15T23:38:04.055412+0000","last_clean":"2024-04-15T23:38:04.055412+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055412+0000","last_undegraded":"2024-04-15T23:38:04.055412+0000","last_fullsized":"2024-04-15T23:38:04.055412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":577,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150501+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150501+0000","last_peered":"2024-04-15T23:38:04.150501+0000","last_clean":"2024-04-15T23:38:04.150501+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150501+0000","last_undegraded":"2024-04-15T23:38:04.150501+0000","last_fullsized":"2024-04-15T23:38:04.150501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:42:50.642806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055152+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055152+0000","last_peered":"2024-04-15T23:38:04.055152+0000","last_clean":"2024-04-15T23:38:04.055152+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055152+0000","last_undegraded":"2024-04-15T23:38:04.055152+0000","last_fullsized":"2024-04-15T23:38:04.055152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:35:47.730630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103206,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85412,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286428,"statfs":{"total":96636764160,"available":96549302272,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645316,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80980,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290860,"statfs":{"total":96636764160,"available":96553840640,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88936,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282904,"statfs":{"total":96636764160,"available":96545693696,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:08.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:38:08.865 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:08.866 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":79,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:38:04.051016+0000","last_up_change":"2024-04-15T23:37:53.955442+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":68,"up_from":72,"up_thru":72,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6801","nonce":2789808517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6803","nonce":2789808517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6807","nonce":2789808517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6805","nonce":2789808517}]},"public_addr":"172.21.15.115:6801/2789808517","cluster_addr":"172.21.15.115:6803/2789808517","heartbeat_back_addr":"172.21.15.115:6807/2789808517","heartbeat_front_addr":"172.21.15.115:6805/2789808517","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":23,"up_from":58,"up_thru":72,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6801","nonce":3430252970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6803","nonce":3430252970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6807","nonce":3430252970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6805","nonce":3430252970}]},"public_addr":"172.21.15.195:6801/3430252970","cluster_addr":"172.21.15.195:6803/3430252970","heartbeat_back_addr":"172.21.15.195:6807/3430252970","heartbeat_front_addr":"172.21.15.195:6805/3430252970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":23}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:38:09.880 INFO:tasks.ceph:Scrubbing osd.0 2024-04-15T23:38:09.880 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-15T23:38:10.025 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:38:10.025 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-15T23:38:10.025 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:38:10.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-15T23:38:10.325 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2024-04-15T23:38:10.338 INFO:tasks.ceph:Scrubbing osd.1 2024-04-15T23:38:10.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-15T23:38:10.467 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:38:10.467 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-15T23:38:10.467 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:38:10.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-15T23:38:10.774 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2024-04-15T23:38:10.788 INFO:tasks.ceph:Scrubbing osd.2 2024-04-15T23:38:10.788 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-15T23:38:10.916 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-04-15T23:38:10.917 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-15T23:38:10.917 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-04-15T23:38:10.927 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-15T23:38:11.211 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2024-04-15T23:38:11.224 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:11.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:11.514 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:11.523 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-04-15T23:38:09.882213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11003,"ondisk_log_size":11003,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255328,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860192,"statfs":{"total":289910292480,"available":289648836608,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.840276"},"pg_stats":[{"pgid":"4.3f","version":"53'152","reported_seq":506,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055400+0000","last_change":"2024-04-15T23:35:13.299821+0000","last_active":"2024-04-15T23:38:04.055400+0000","last_peered":"2024-04-15T23:38:04.055400+0000","last_clean":"2024-04-15T23:38:04.055400+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:04.055400+0000","last_undegraded":"2024-04-15T23:38:04.055400+0000","last_fullsized":"2024-04-15T23:38:04.055400+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:25.202799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"53'150","reported_seq":494,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055039+0000","last_change":"2024-04-15T23:35:15.303800+0000","last_active":"2024-04-15T23:38:04.055039+0000","last_peered":"2024-04-15T23:38:04.055039+0000","last_clean":"2024-04-15T23:38:04.055039+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:04.055039+0000","last_undegraded":"2024-04-15T23:38:04.055039+0000","last_fullsized":"2024-04-15T23:38:04.055039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:46:57.545710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151265+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151265+0000","last_peered":"2024-04-15T23:38:04.151265+0000","last_clean":"2024-04-15T23:38:04.151265+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151265+0000","last_undegraded":"2024-04-15T23:38:04.151265+0000","last_fullsized":"2024-04-15T23:38:04.151265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:18:46.142265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":446,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150655+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150655+0000","last_peered":"2024-04-15T23:38:04.150655+0000","last_clean":"2024-04-15T23:38:04.150655+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150655+0000","last_undegraded":"2024-04-15T23:38:04.150655+0000","last_fullsized":"2024-04-15T23:38:04.150655+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:06:46.388157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"53'173","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:15.300722+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:12:45.462063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":537,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150937+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.150937+0000","last_peered":"2024-04-15T23:38:04.150937+0000","last_clean":"2024-04-15T23:38:04.150937+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.150937+0000","last_undegraded":"2024-04-15T23:38:04.150937+0000","last_fullsized":"2024-04-15T23:38:04.150937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:49:46.849666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":528,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:57.967361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"53'143","reported_seq":461,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150156+0000","last_change":"2024-04-15T23:37:54.979553+0000","last_active":"2024-04-15T23:38:04.150156+0000","last_peered":"2024-04-15T23:38:04.150156+0000","last_clean":"2024-04-15T23:38:04.150156+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:04.150156+0000","last_undegraded":"2024-04-15T23:38:04.150156+0000","last_fullsized":"2024-04-15T23:38:04.150156+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:10:07.716446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"53'167","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055404+0000","last_change":"2024-04-15T23:35:14.300305+0000","last_active":"2024-04-15T23:38:04.055404+0000","last_peered":"2024-04-15T23:38:04.055404+0000","last_clean":"2024-04-15T23:38:04.055404+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:04.055404+0000","last_undegraded":"2024-04-15T23:38:04.055404+0000","last_fullsized":"2024-04-15T23:38:04.055404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:03:47.365265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055091+0000","last_change":"2024-04-15T23:35:16.298718+0000","last_active":"2024-04-15T23:38:04.055091+0000","last_peered":"2024-04-15T23:38:04.055091+0000","last_clean":"2024-04-15T23:38:04.055091+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:04.055091+0000","last_undegraded":"2024-04-15T23:38:04.055091+0000","last_fullsized":"2024-04-15T23:38:04.055091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:15.055643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":495,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151157+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151157+0000","last_peered":"2024-04-15T23:38:04.151157+0000","last_clean":"2024-04-15T23:38:04.151157+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151157+0000","last_undegraded":"2024-04-15T23:38:04.151157+0000","last_fullsized":"2024-04-15T23:38:04.151157+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:38:44.888221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"53'141","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:37:54.980913+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:15:05.402863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"53'135","reported_seq":462,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054625+0000","last_change":"2024-04-15T23:35:14.299670+0000","last_active":"2024-04-15T23:38:04.054625+0000","last_peered":"2024-04-15T23:38:04.054625+0000","last_clean":"2024-04-15T23:38:04.054625+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:04.054625+0000","last_undegraded":"2024-04-15T23:38:04.054625+0000","last_fullsized":"2024-04-15T23:38:04.054625+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:40.541421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":288,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150828+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150828+0000","last_peered":"2024-04-15T23:38:04.150828+0000","last_clean":"2024-04-15T23:38:04.150828+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150828+0000","last_undegraded":"2024-04-15T23:38:04.150828+0000","last_fullsized":"2024-04-15T23:38:04.150828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:13:18.828403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150330+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150330+0000","last_peered":"2024-04-15T23:38:04.150330+0000","last_clean":"2024-04-15T23:38:04.150330+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150330+0000","last_undegraded":"2024-04-15T23:38:04.150330+0000","last_fullsized":"2024-04-15T23:38:04.150330+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:29:51.531478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"53'177","reported_seq":547,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150536+0000","last_change":"2024-04-15T23:37:54.977342+0000","last_active":"2024-04-15T23:38:04.150536+0000","last_peered":"2024-04-15T23:38:04.150536+0000","last_clean":"2024-04-15T23:38:04.150536+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:04.150536+0000","last_undegraded":"2024-04-15T23:38:04.150536+0000","last_fullsized":"2024-04-15T23:38:04.150536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:08:13.888680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"53'165","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055354+0000","last_change":"2024-04-15T23:35:13.298900+0000","last_active":"2024-04-15T23:38:04.055354+0000","last_peered":"2024-04-15T23:38:04.055354+0000","last_clean":"2024-04-15T23:38:04.055354+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:04.055354+0000","last_undegraded":"2024-04-15T23:38:04.055354+0000","last_fullsized":"2024-04-15T23:38:04.055354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:05:49.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"53'150","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055324+0000","last_change":"2024-04-15T23:35:16.299556+0000","last_active":"2024-04-15T23:38:04.055324+0000","last_peered":"2024-04-15T23:38:04.055324+0000","last_clean":"2024-04-15T23:38:04.055324+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:04.055324+0000","last_undegraded":"2024-04-15T23:38:04.055324+0000","last_fullsized":"2024-04-15T23:38:04.055324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:22.997439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"53'144","reported_seq":252,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054942+0000","last_change":"2024-04-15T23:35:16.299118+0000","last_active":"2024-04-15T23:38:04.054942+0000","last_peered":"2024-04-15T23:38:04.054942+0000","last_clean":"2024-04-15T23:38:04.054942+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:04.054942+0000","last_undegraded":"2024-04-15T23:38:04.054942+0000","last_fullsized":"2024-04-15T23:38:04.054942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:43:18.487431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"53'198","reported_seq":568,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150860+0000","last_change":"2024-04-15T23:37:54.974826+0000","last_active":"2024-04-15T23:38:04.150860+0000","last_peered":"2024-04-15T23:38:04.150860+0000","last_clean":"2024-04-15T23:38:04.150860+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:04.150860+0000","last_undegraded":"2024-04-15T23:38:04.150860+0000","last_fullsized":"2024-04-15T23:38:04.150860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:51:36.179704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"53'162","reported_seq":516,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151233+0000","last_change":"2024-04-15T23:37:54.975373+0000","last_active":"2024-04-15T23:38:04.151233+0000","last_peered":"2024-04-15T23:38:04.151233+0000","last_clean":"2024-04-15T23:38:04.151233+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:04.151233+0000","last_undegraded":"2024-04-15T23:38:04.151233+0000","last_fullsized":"2024-04-15T23:38:04.151233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:44.503479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"53'170","reported_seq":319,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054482+0000","last_change":"2024-04-15T23:37:54.984078+0000","last_active":"2024-04-15T23:38:04.054482+0000","last_peered":"2024-04-15T23:38:04.054482+0000","last_clean":"2024-04-15T23:38:04.054482+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:04.054482+0000","last_undegraded":"2024-04-15T23:38:04.054482+0000","last_fullsized":"2024-04-15T23:38:04.054482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:04:28.242880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"53'162","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054340+0000","last_change":"2024-04-15T23:37:54.970987+0000","last_active":"2024-04-15T23:38:04.054340+0000","last_peered":"2024-04-15T23:38:04.054340+0000","last_clean":"2024-04-15T23:38:04.054340+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:04.054340+0000","last_undegraded":"2024-04-15T23:38:04.054340+0000","last_fullsized":"2024-04-15T23:38:04.054340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:54.676743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054295+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054295+0000","last_peered":"2024-04-15T23:38:04.054295+0000","last_clean":"2024-04-15T23:38:04.054295+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054295+0000","last_undegraded":"2024-04-15T23:38:04.054295+0000","last_fullsized":"2024-04-15T23:38:04.054295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:39.571139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"53'156","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055405+0000","last_change":"2024-04-15T23:37:54.980092+0000","last_active":"2024-04-15T23:38:04.055405+0000","last_peered":"2024-04-15T23:38:04.055405+0000","last_clean":"2024-04-15T23:38:04.055405+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:04.055405+0000","last_undegraded":"2024-04-15T23:38:04.055405+0000","last_fullsized":"2024-04-15T23:38:04.055405+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:57.488763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":305,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055369+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055369+0000","last_peered":"2024-04-15T23:38:04.055369+0000","last_clean":"2024-04-15T23:38:04.055369+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055369+0000","last_undegraded":"2024-04-15T23:38:04.055369+0000","last_fullsized":"2024-04-15T23:38:04.055369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:15:42.611220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":267,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151158+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151158+0000","last_peered":"2024-04-15T23:38:04.151158+0000","last_clean":"2024-04-15T23:38:04.151158+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151158+0000","last_undegraded":"2024-04-15T23:38:04.151158+0000","last_fullsized":"2024-04-15T23:38:04.151158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:08.814823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":301,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055032+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055032+0000","last_peered":"2024-04-15T23:38:04.055032+0000","last_clean":"2024-04-15T23:38:04.055032+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055032+0000","last_undegraded":"2024-04-15T23:38:04.055032+0000","last_fullsized":"2024-04-15T23:38:04.055032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:56.957050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"53'167","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054430+0000","last_change":"2024-04-15T23:35:15.296264+0000","last_active":"2024-04-15T23:38:04.054430+0000","last_peered":"2024-04-15T23:38:04.054430+0000","last_clean":"2024-04-15T23:38:04.054430+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:04.054430+0000","last_undegraded":"2024-04-15T23:38:04.054430+0000","last_fullsized":"2024-04-15T23:38:04.054430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:33:06.391410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054605+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054605+0000","last_peered":"2024-04-15T23:38:04.054605+0000","last_clean":"2024-04-15T23:38:04.054605+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054605+0000","last_undegraded":"2024-04-15T23:38:04.054605+0000","last_fullsized":"2024-04-15T23:38:04.054605+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:42:47.190183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054713+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054713+0000","last_peered":"2024-04-15T23:38:04.054713+0000","last_clean":"2024-04-15T23:38:04.054713+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054713+0000","last_undegraded":"2024-04-15T23:38:04.054713+0000","last_fullsized":"2024-04-15T23:38:04.054713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:10:44.185097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"53'181","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150050+0000","last_change":"2024-04-15T23:37:54.979663+0000","last_active":"2024-04-15T23:38:04.150050+0000","last_peered":"2024-04-15T23:38:04.150050+0000","last_clean":"2024-04-15T23:38:04.150050+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:04.150050+0000","last_undegraded":"2024-04-15T23:38:04.150050+0000","last_fullsized":"2024-04-15T23:38:04.150050+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:16:39.846762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"53'153","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:14.300159+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:25:25.204523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150353+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150353+0000","last_peered":"2024-04-15T23:38:04.150353+0000","last_clean":"2024-04-15T23:38:04.150353+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150353+0000","last_undegraded":"2024-04-15T23:38:04.150353+0000","last_fullsized":"2024-04-15T23:38:04.150353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:45:18.917831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055118+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055118+0000","last_peered":"2024-04-15T23:38:04.055118+0000","last_clean":"2024-04-15T23:38:04.055118+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055118+0000","last_undegraded":"2024-04-15T23:38:04.055118+0000","last_fullsized":"2024-04-15T23:38:04.055118+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:16:01.526892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054459+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054459+0000","last_peered":"2024-04-15T23:38:04.054459+0000","last_clean":"2024-04-15T23:38:04.054459+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054459+0000","last_undegraded":"2024-04-15T23:38:04.054459+0000","last_fullsized":"2024-04-15T23:38:04.054459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:55:48.663512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"53'192","reported_seq":309,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.970465+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:21.553276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":151,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054650+0000","last_change":"2024-04-15T23:37:54.975024+0000","last_active":"2024-04-15T23:38:04.054650+0000","last_peered":"2024-04-15T23:38:04.054650+0000","last_clean":"2024-04-15T23:38:04.054650+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:04.054650+0000","last_undegraded":"2024-04-15T23:38:04.054650+0000","last_fullsized":"2024-04-15T23:38:04.054650+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:07:57.085578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055211+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055211+0000","last_peered":"2024-04-15T23:38:04.055211+0000","last_clean":"2024-04-15T23:38:04.055211+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055211+0000","last_undegraded":"2024-04-15T23:38:04.055211+0000","last_fullsized":"2024-04-15T23:38:04.055211+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:45.722182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"46'9","reported_seq":109,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150030+0000","last_change":"2024-04-15T23:37:54.980128+0000","last_active":"2024-04-15T23:38:04.150030+0000","last_peered":"2024-04-15T23:38:04.150030+0000","last_clean":"2024-04-15T23:38:04.150030+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:04.150030+0000","last_undegraded":"2024-04-15T23:38:04.150030+0000","last_fullsized":"2024-04-15T23:38:04.150030+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:26:41.575192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151238+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151238+0000","last_peered":"2024-04-15T23:38:04.151238+0000","last_clean":"2024-04-15T23:38:04.151238+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151238+0000","last_undegraded":"2024-04-15T23:38:04.151238+0000","last_fullsized":"2024-04-15T23:38:04.151238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:50:43.826554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"53'153","reported_seq":303,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054304+0000","last_change":"2024-04-15T23:37:54.980087+0000","last_active":"2024-04-15T23:38:04.054304+0000","last_peered":"2024-04-15T23:38:04.054304+0000","last_clean":"2024-04-15T23:38:04.054304+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:04.054304+0000","last_undegraded":"2024-04-15T23:38:04.054304+0000","last_fullsized":"2024-04-15T23:38:04.054304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:40:49.638064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055338+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:04.055338+0000","last_peered":"2024-04-15T23:38:04.055338+0000","last_clean":"2024-04-15T23:38:04.055338+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:04.055338+0000","last_undegraded":"2024-04-15T23:38:04.055338+0000","last_fullsized":"2024-04-15T23:38:04.055338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:57.191947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":566,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054387+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054387+0000","last_peered":"2024-04-15T23:38:04.054387+0000","last_clean":"2024-04-15T23:38:04.054387+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054387+0000","last_undegraded":"2024-04-15T23:38:04.054387+0000","last_fullsized":"2024-04-15T23:38:04.054387+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:19:36.958302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150879+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.150879+0000","last_peered":"2024-04-15T23:38:04.150879+0000","last_clean":"2024-04-15T23:38:04.150879+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.150879+0000","last_undegraded":"2024-04-15T23:38:04.150879+0000","last_fullsized":"2024-04-15T23:38:04.150879+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:38:27.066961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"53'147","reported_seq":491,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151007+0000","last_change":"2024-04-15T23:37:54.975622+0000","last_active":"2024-04-15T23:38:04.151007+0000","last_peered":"2024-04-15T23:38:04.151007+0000","last_clean":"2024-04-15T23:38:04.151007+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:04.151007+0000","last_undegraded":"2024-04-15T23:38:04.151007+0000","last_fullsized":"2024-04-15T23:38:04.151007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:17:12.523528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150683+0000","last_change":"2024-04-15T23:37:54.974738+0000","last_active":"2024-04-15T23:38:04.150683+0000","last_peered":"2024-04-15T23:38:04.150683+0000","last_clean":"2024-04-15T23:38:04.150683+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:04.150683+0000","last_undegraded":"2024-04-15T23:38:04.150683+0000","last_fullsized":"2024-04-15T23:38:04.150683+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:41:17.825004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":275,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055234+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055234+0000","last_peered":"2024-04-15T23:38:04.055234+0000","last_clean":"2024-04-15T23:38:04.055234+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055234+0000","last_undegraded":"2024-04-15T23:38:04.055234+0000","last_fullsized":"2024-04-15T23:38:04.055234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:50:08.878782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054981+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.054981+0000","last_peered":"2024-04-15T23:38:04.054981+0000","last_clean":"2024-04-15T23:38:04.054981+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.054981+0000","last_undegraded":"2024-04-15T23:38:04.054981+0000","last_fullsized":"2024-04-15T23:38:04.054981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:46:16.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"53'180","reported_seq":562,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150966+0000","last_change":"2024-04-15T23:37:54.975504+0000","last_active":"2024-04-15T23:38:04.150966+0000","last_peered":"2024-04-15T23:38:04.150966+0000","last_clean":"2024-04-15T23:38:04.150966+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:04.150966+0000","last_undegraded":"2024-04-15T23:38:04.150966+0000","last_fullsized":"2024-04-15T23:38:04.150966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:54:46.898348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150389+0000","last_change":"2024-04-15T23:37:54.974969+0000","last_active":"2024-04-15T23:38:04.150389+0000","last_peered":"2024-04-15T23:38:04.150389+0000","last_clean":"2024-04-15T23:38:04.150389+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:04.150389+0000","last_undegraded":"2024-04-15T23:38:04.150389+0000","last_fullsized":"2024-04-15T23:38:04.150389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:14:24.991458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150768+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150768+0000","last_peered":"2024-04-15T23:38:04.150768+0000","last_clean":"2024-04-15T23:38:04.150768+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150768+0000","last_undegraded":"2024-04-15T23:38:04.150768+0000","last_fullsized":"2024-04-15T23:38:04.150768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:45:24.736666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":152,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054719+0000","last_change":"2024-04-15T23:37:54.975484+0000","last_active":"2024-04-15T23:38:04.054719+0000","last_peered":"2024-04-15T23:38:04.054719+0000","last_clean":"2024-04-15T23:38:04.054719+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:04.054719+0000","last_undegraded":"2024-04-15T23:38:04.054719+0000","last_fullsized":"2024-04-15T23:38:04.054719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:33:35.880580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"53'138","reported_seq":248,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151067+0000","last_change":"2024-04-15T23:37:54.979558+0000","last_active":"2024-04-15T23:38:04.151067+0000","last_peered":"2024-04-15T23:38:04.151067+0000","last_clean":"2024-04-15T23:38:04.151067+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:04.151067+0000","last_undegraded":"2024-04-15T23:38:04.151067+0000","last_fullsized":"2024-04-15T23:38:04.151067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:34:18.459971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":153,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054445+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054445+0000","last_peered":"2024-04-15T23:38:04.054445+0000","last_clean":"2024-04-15T23:38:04.054445+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054445+0000","last_undegraded":"2024-04-15T23:38:04.054445+0000","last_fullsized":"2024-04-15T23:38:04.054445+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:10:08.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"53'145","reported_seq":259,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055602+0000","last_change":"2024-04-15T23:35:13.299948+0000","last_active":"2024-04-15T23:38:04.055602+0000","last_peered":"2024-04-15T23:38:04.055602+0000","last_clean":"2024-04-15T23:38:04.055602+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:04.055602+0000","last_undegraded":"2024-04-15T23:38:04.055602+0000","last_fullsized":"2024-04-15T23:38:04.055602+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:27:34.300386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.149931+0000","last_change":"2024-04-15T23:37:54.980406+0000","last_active":"2024-04-15T23:38:04.149931+0000","last_peered":"2024-04-15T23:38:04.149931+0000","last_clean":"2024-04-15T23:38:04.149931+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:04.149931+0000","last_undegraded":"2024-04-15T23:38:04.149931+0000","last_fullsized":"2024-04-15T23:38:04.149931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:06.260508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150220+0000","last_change":"2024-04-15T23:37:54.975952+0000","last_active":"2024-04-15T23:38:04.150220+0000","last_peered":"2024-04-15T23:38:04.150220+0000","last_clean":"2024-04-15T23:38:04.150220+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:04.150220+0000","last_undegraded":"2024-04-15T23:38:04.150220+0000","last_fullsized":"2024-04-15T23:38:04.150220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:11.183075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054759+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054759+0000","last_peered":"2024-04-15T23:38:04.054759+0000","last_clean":"2024-04-15T23:38:04.054759+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054759+0000","last_undegraded":"2024-04-15T23:38:04.054759+0000","last_fullsized":"2024-04-15T23:38:04.054759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:40.455061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151039+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151039+0000","last_peered":"2024-04-15T23:38:04.151039+0000","last_clean":"2024-04-15T23:38:04.151039+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151039+0000","last_undegraded":"2024-04-15T23:38:04.151039+0000","last_fullsized":"2024-04-15T23:38:04.151039+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:20:33.862210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150243+0000","last_change":"2024-04-15T23:37:54.980322+0000","last_active":"2024-04-15T23:38:04.150243+0000","last_peered":"2024-04-15T23:38:04.150243+0000","last_clean":"2024-04-15T23:38:04.150243+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:04.150243+0000","last_undegraded":"2024-04-15T23:38:04.150243+0000","last_fullsized":"2024-04-15T23:38:04.150243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:04:30.063643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"51'35","reported_seq":72,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054307+0000","last_change":"2024-04-15T23:37:54.969392+0000","last_active":"2024-04-15T23:38:04.054307+0000","last_peered":"2024-04-15T23:38:04.054307+0000","last_clean":"2024-04-15T23:38:04.054307+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:04.054307+0000","last_undegraded":"2024-04-15T23:38:04.054307+0000","last_fullsized":"2024-04-15T23:38:04.054307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:11:34.602096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"53'159","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055197+0000","last_change":"2024-04-15T23:35:15.300798+0000","last_active":"2024-04-15T23:38:04.055197+0000","last_peered":"2024-04-15T23:38:04.055197+0000","last_clean":"2024-04-15T23:38:04.055197+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:04.055197+0000","last_undegraded":"2024-04-15T23:38:04.055197+0000","last_fullsized":"2024-04-15T23:38:04.055197+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:49:35.997487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054520+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054520+0000","last_peered":"2024-04-15T23:38:04.054520+0000","last_clean":"2024-04-15T23:38:04.054520+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054520+0000","last_undegraded":"2024-04-15T23:38:04.054520+0000","last_fullsized":"2024-04-15T23:38:04.054520+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:33.745359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"48'56","reported_seq":208,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054569+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.054569+0000","last_peered":"2024-04-15T23:38:04.054569+0000","last_clean":"2024-04-15T23:38:04.054569+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:04.054569+0000","last_undegraded":"2024-04-15T23:38:04.054569+0000","last_fullsized":"2024-04-15T23:38:04.054569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:00:37.906391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"53'164","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055575+0000","last_change":"2024-04-15T23:35:12.301863+0000","last_active":"2024-04-15T23:38:04.055575+0000","last_peered":"2024-04-15T23:38:04.055575+0000","last_clean":"2024-04-15T23:38:04.055575+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:04.055575+0000","last_undegraded":"2024-04-15T23:38:04.055575+0000","last_fullsized":"2024-04-15T23:38:04.055575+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:36:41.915199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":140,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150089+0000","last_change":"2024-04-15T23:37:54.974977+0000","last_active":"2024-04-15T23:38:04.150089+0000","last_peered":"2024-04-15T23:38:04.150089+0000","last_clean":"2024-04-15T23:38:04.150089+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:04.150089+0000","last_undegraded":"2024-04-15T23:38:04.150089+0000","last_fullsized":"2024-04-15T23:38:04.150089+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:17:35.757175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150304+0000","last_change":"2024-04-15T23:37:54.976495+0000","last_active":"2024-04-15T23:38:04.150304+0000","last_peered":"2024-04-15T23:38:04.150304+0000","last_clean":"2024-04-15T23:38:04.150304+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:04.150304+0000","last_undegraded":"2024-04-15T23:38:04.150304+0000","last_fullsized":"2024-04-15T23:38:04.150304+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:22:39.677169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"53'157","reported_seq":269,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054628+0000","last_change":"2024-04-15T23:35:14.300695+0000","last_active":"2024-04-15T23:38:04.054628+0000","last_peered":"2024-04-15T23:38:04.054628+0000","last_clean":"2024-04-15T23:38:04.054628+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:04.054628+0000","last_undegraded":"2024-04-15T23:38:04.054628+0000","last_fullsized":"2024-04-15T23:38:04.054628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:03:30.278339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150576+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150576+0000","last_peered":"2024-04-15T23:38:04.150576+0000","last_clean":"2024-04-15T23:38:04.150576+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150576+0000","last_undegraded":"2024-04-15T23:38:04.150576+0000","last_fullsized":"2024-04-15T23:38:04.150576+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:04:50.254802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054602+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054602+0000","last_peered":"2024-04-15T23:38:04.054602+0000","last_clean":"2024-04-15T23:38:04.054602+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054602+0000","last_undegraded":"2024-04-15T23:38:04.054602+0000","last_fullsized":"2024-04-15T23:38:04.054602+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:25:46.861854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":361,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054539+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054539+0000","last_peered":"2024-04-15T23:38:04.054539+0000","last_clean":"2024-04-15T23:38:04.054539+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054539+0000","last_undegraded":"2024-04-15T23:38:04.054539+0000","last_fullsized":"2024-04-15T23:38:04.054539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:22.640720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054834+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054834+0000","last_peered":"2024-04-15T23:38:04.054834+0000","last_clean":"2024-04-15T23:38:04.054834+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054834+0000","last_undegraded":"2024-04-15T23:38:04.054834+0000","last_fullsized":"2024-04-15T23:38:04.054834+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:51:38.765828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055329+0000","last_change":"2024-04-15T23:35:07.906853+0000","last_active":"2024-04-15T23:38:04.055329+0000","last_peered":"2024-04-15T23:38:04.055329+0000","last_clean":"2024-04-15T23:38:04.055329+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:04.055329+0000","last_undegraded":"2024-04-15T23:38:04.055329+0000","last_fullsized":"2024-04-15T23:38:04.055329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:22:37.099266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"53'180","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:37:54.980855+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:35:03.374439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":65,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055280+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055280+0000","last_peered":"2024-04-15T23:38:04.055280+0000","last_clean":"2024-04-15T23:38:04.055280+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055280+0000","last_undegraded":"2024-04-15T23:38:04.055280+0000","last_fullsized":"2024-04-15T23:38:04.055280+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:34.043288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055018+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055018+0000","last_peered":"2024-04-15T23:38:04.055018+0000","last_clean":"2024-04-15T23:38:04.055018+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055018+0000","last_undegraded":"2024-04-15T23:38:04.055018+0000","last_fullsized":"2024-04-15T23:38:04.055018+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:50.500184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:01:26.754333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"53'36","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055007+0000","last_change":"2024-04-15T23:37:54.969099+0000","last_active":"2024-04-15T23:38:04.055007+0000","last_peered":"2024-04-15T23:38:04.055007+0000","last_clean":"2024-04-15T23:38:04.055007+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:04.055007+0000","last_undegraded":"2024-04-15T23:38:04.055007+0000","last_fullsized":"2024-04-15T23:38:04.055007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:33:24.025837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":117,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150996+0000","last_change":"2024-04-15T23:37:54.977549+0000","last_active":"2024-04-15T23:38:04.150996+0000","last_peered":"2024-04-15T23:38:04.150996+0000","last_clean":"2024-04-15T23:38:04.150996+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:04.150996+0000","last_undegraded":"2024-04-15T23:38:04.150996+0000","last_fullsized":"2024-04-15T23:38:04.150996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:20:29.898627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"53'142","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054388+0000","last_change":"2024-04-15T23:37:54.983847+0000","last_active":"2024-04-15T23:38:04.054388+0000","last_peered":"2024-04-15T23:38:04.054388+0000","last_clean":"2024-04-15T23:38:04.054388+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:04.054388+0000","last_undegraded":"2024-04-15T23:38:04.054388+0000","last_fullsized":"2024-04-15T23:38:04.054388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:08:01.568734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":261,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150777+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150777+0000","last_peered":"2024-04-15T23:38:04.150777+0000","last_clean":"2024-04-15T23:38:04.150777+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150777+0000","last_undegraded":"2024-04-15T23:38:04.150777+0000","last_fullsized":"2024-04-15T23:38:04.150777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:25:56.623760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":163,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150376+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150376+0000","last_peered":"2024-04-15T23:38:04.150376+0000","last_clean":"2024-04-15T23:38:04.150376+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150376+0000","last_undegraded":"2024-04-15T23:38:04.150376+0000","last_fullsized":"2024-04-15T23:38:04.150376+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:57:32.784527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"53'147","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054428+0000","last_change":"2024-04-15T23:35:12.301606+0000","last_active":"2024-04-15T23:38:04.054428+0000","last_peered":"2024-04-15T23:38:04.054428+0000","last_clean":"2024-04-15T23:38:04.054428+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:04.054428+0000","last_undegraded":"2024-04-15T23:38:04.054428+0000","last_fullsized":"2024-04-15T23:38:04.054428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:19:29.485616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":174,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:54:03.314247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":134,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150917+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150917+0000","last_peered":"2024-04-15T23:38:04.150917+0000","last_clean":"2024-04-15T23:38:04.150917+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150917+0000","last_undegraded":"2024-04-15T23:38:04.150917+0000","last_fullsized":"2024-04-15T23:38:04.150917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:30:42.892541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":299,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054473+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054473+0000","last_peered":"2024-04-15T23:38:04.054473+0000","last_clean":"2024-04-15T23:38:04.054473+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054473+0000","last_undegraded":"2024-04-15T23:38:04.054473+0000","last_fullsized":"2024-04-15T23:38:04.054473+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:20:23.720332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055487+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.055487+0000","last_peered":"2024-04-15T23:38:04.055487+0000","last_clean":"2024-04-15T23:38:04.055487+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:04.055487+0000","last_undegraded":"2024-04-15T23:38:04.055487+0000","last_fullsized":"2024-04-15T23:38:04.055487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:11:04.686698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"53'159","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054313+0000","last_change":"2024-04-15T23:35:10.302738+0000","last_active":"2024-04-15T23:38:04.054313+0000","last_peered":"2024-04-15T23:38:04.054313+0000","last_clean":"2024-04-15T23:38:04.054313+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:04.054313+0000","last_undegraded":"2024-04-15T23:38:04.054313+0000","last_fullsized":"2024-04-15T23:38:04.054313+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:20:24.772071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055521+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055521+0000","last_peered":"2024-04-15T23:38:04.055521+0000","last_clean":"2024-04-15T23:38:04.055521+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055521+0000","last_undegraded":"2024-04-15T23:38:04.055521+0000","last_fullsized":"2024-04-15T23:38:04.055521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:37:38.502349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":61,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054157+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054157+0000","last_peered":"2024-04-15T23:38:04.054157+0000","last_clean":"2024-04-15T23:38:04.054157+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054157+0000","last_undegraded":"2024-04-15T23:38:04.054157+0000","last_fullsized":"2024-04-15T23:38:04.054157+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:00:47.875369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":272,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055283+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055283+0000","last_peered":"2024-04-15T23:38:04.055283+0000","last_clean":"2024-04-15T23:38:04.055283+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055283+0000","last_undegraded":"2024-04-15T23:38:04.055283+0000","last_fullsized":"2024-04-15T23:38:04.055283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:09.331923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":68,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054226+0000","last_change":"2024-04-15T23:37:54.969689+0000","last_active":"2024-04-15T23:38:04.054226+0000","last_peered":"2024-04-15T23:38:04.054226+0000","last_clean":"2024-04-15T23:38:04.054226+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:04.054226+0000","last_undegraded":"2024-04-15T23:38:04.054226+0000","last_fullsized":"2024-04-15T23:38:04.054226+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:16:27.272034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":297,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054836+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054836+0000","last_peered":"2024-04-15T23:38:04.054836+0000","last_clean":"2024-04-15T23:38:04.054836+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054836+0000","last_undegraded":"2024-04-15T23:38:04.054836+0000","last_fullsized":"2024-04-15T23:38:04.054836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:37:11.947230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":158,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054878+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054878+0000","last_peered":"2024-04-15T23:38:04.054878+0000","last_clean":"2024-04-15T23:38:04.054878+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054878+0000","last_undegraded":"2024-04-15T23:38:04.054878+0000","last_fullsized":"2024-04-15T23:38:04.054878+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:39.929212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":521,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054669+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054669+0000","last_peered":"2024-04-15T23:38:04.054669+0000","last_clean":"2024-04-15T23:38:04.054669+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054669+0000","last_undegraded":"2024-04-15T23:38:04.054669+0000","last_fullsized":"2024-04-15T23:38:04.054669+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:42:21.784931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"45'5","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054921+0000","last_change":"2024-04-15T23:37:54.983724+0000","last_active":"2024-04-15T23:38:04.054921+0000","last_peered":"2024-04-15T23:38:04.054921+0000","last_clean":"2024-04-15T23:38:04.054921+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:04.054921+0000","last_undegraded":"2024-04-15T23:38:04.054921+0000","last_fullsized":"2024-04-15T23:38:04.054921+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:09.088379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":517,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150652+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150652+0000","last_peered":"2024-04-15T23:38:04.150652+0000","last_clean":"2024-04-15T23:38:04.150652+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150652+0000","last_undegraded":"2024-04-15T23:38:04.150652+0000","last_fullsized":"2024-04-15T23:38:04.150652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:01:49.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":136,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150486+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150486+0000","last_peered":"2024-04-15T23:38:04.150486+0000","last_clean":"2024-04-15T23:38:04.150486+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150486+0000","last_undegraded":"2024-04-15T23:38:04.150486+0000","last_fullsized":"2024-04-15T23:38:04.150486+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:40:12.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":507,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150392+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150392+0000","last_peered":"2024-04-15T23:38:04.150392+0000","last_clean":"2024-04-15T23:38:04.150392+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150392+0000","last_undegraded":"2024-04-15T23:38:04.150392+0000","last_fullsized":"2024-04-15T23:38:04.150392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:09:10.597065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":210,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055160+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055160+0000","last_peered":"2024-04-15T23:38:04.055160+0000","last_clean":"2024-04-15T23:38:04.055160+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055160+0000","last_undegraded":"2024-04-15T23:38:04.055160+0000","last_fullsized":"2024-04-15T23:38:04.055160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:06:42.810034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":532,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054783+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054783+0000","last_peered":"2024-04-15T23:38:04.054783+0000","last_clean":"2024-04-15T23:38:04.054783+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054783+0000","last_undegraded":"2024-04-15T23:38:04.054783+0000","last_fullsized":"2024-04-15T23:38:04.054783+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:45:55.001839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055412+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055412+0000","last_peered":"2024-04-15T23:38:04.055412+0000","last_clean":"2024-04-15T23:38:04.055412+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055412+0000","last_undegraded":"2024-04-15T23:38:04.055412+0000","last_fullsized":"2024-04-15T23:38:04.055412+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:43:42.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":577,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150501+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150501+0000","last_peered":"2024-04-15T23:38:04.150501+0000","last_clean":"2024-04-15T23:38:04.150501+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150501+0000","last_undegraded":"2024-04-15T23:38:04.150501+0000","last_fullsized":"2024-04-15T23:38:04.150501+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:42:50.642806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055152+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055152+0000","last_peered":"2024-04-15T23:38:04.055152+0000","last_clean":"2024-04-15T23:38:04.055152+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055152+0000","last_undegraded":"2024-04-15T23:38:04.055152+0000","last_fullsized":"2024-04-15T23:38:04.055152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:35:47.730630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10414,"ondisk_log_size":10414,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":432,"ondisk_log_size":432,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103206,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85412,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":39993,"kb_avail":94286428,"statfs":{"total":96636764160,"available":96549302272,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":40953063},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645317,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80980,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290860,"statfs":{"total":96636764160,"available":96553840640,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88936,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282904,"statfs":{"total":96636764160,"available":96545693696,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:11.532 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.532 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.532 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.532 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.532 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.533 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.534 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.534 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.534 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.534 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.534 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.534 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.535 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.535 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.535 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.535 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.535 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.535 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.536 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.536 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.536 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.536 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.536 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.536 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.537 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.537 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.537 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.537 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.537 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.537 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.538 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.538 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.538 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.538 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.538 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.538 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.539 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.540 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.540 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.540 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.540 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.540 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.540 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.541 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.541 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.541 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.541 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.541 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.541 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.542 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.542 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.542 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.542 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.542 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.543 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.544 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.544 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.544 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.544 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.544 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.544 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.545 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.545 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.545 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.545 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.545 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.545 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.546 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.546 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.546 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.546 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.546 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.546 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.547 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.548 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.548 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.548 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.548 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.548 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.548 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.549 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:11.549 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T23:38:31.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:31.854 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:31.856 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:31.865 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-04-15T23:38:29.886701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12779,"ondisk_log_size":12779,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":246980,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":91251,"kb_avail":282868540,"statfs":{"total":289910292480,"available":289657384960,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":93441071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002905"},"pg_stats":[{"pgid":"4.3f","version":"79'211","reported_seq":576,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.630468+0000","last_change":"2024-04-15T23:38:27.630503+0000","last_active":"2024-04-15T23:38:27.630468+0000","last_peered":"2024-04-15T23:38:27.630468+0000","last_clean":"2024-04-15T23:38:27.630468+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:27.630468+0000","last_undegraded":"2024-04-15T23:38:27.630468+0000","last_fullsized":"2024-04-15T23:38:27.630468+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:27.630388+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:27.630388+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.630388+0000","objects_scrubbed":59,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:51:05.111250+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"79'198","reported_seq":552,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.571390+0000","last_change":"2024-04-15T23:38:17.571459+0000","last_active":"2024-04-15T23:38:17.571390+0000","last_peered":"2024-04-15T23:38:17.571390+0000","last_clean":"2024-04-15T23:38:17.571390+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:17.571390+0000","last_undegraded":"2024-04-15T23:38:17.571390+0000","last_fullsized":"2024-04-15T23:38:17.571390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'198","last_scrub_stamp":"2024-04-15T23:38:17.571310+0000","last_deep_scrub":"79'198","last_deep_scrub_stamp":"2024-04-15T23:38:17.571310+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.571310+0000","objects_scrubbed":48,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:50.447066+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":281,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151313+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151313+0000","last_peered":"2024-04-15T23:38:04.151313+0000","last_clean":"2024-04-15T23:38:04.151313+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151313+0000","last_undegraded":"2024-04-15T23:38:04.151313+0000","last_fullsized":"2024-04-15T23:38:04.151313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"53'128","reported_seq":447,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150703+0000","last_change":"2024-04-15T23:37:54.970341+0000","last_active":"2024-04-15T23:38:04.150703+0000","last_peered":"2024-04-15T23:38:04.150703+0000","last_clean":"2024-04-15T23:38:04.150703+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:04.150703+0000","last_undegraded":"2024-04-15T23:38:04.150703+0000","last_fullsized":"2024-04-15T23:38:04.150703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"79'246","reported_seq":652,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.598546+0000","last_change":"2024-04-15T23:38:21.598587+0000","last_active":"2024-04-15T23:38:21.598546+0000","last_peered":"2024-04-15T23:38:21.598546+0000","last_clean":"2024-04-15T23:38:21.598546+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:21.598546+0000","last_undegraded":"2024-04-15T23:38:21.598546+0000","last_fullsized":"2024-04-15T23:38:21.598546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'246","last_scrub_stamp":"2024-04-15T23:38:21.598451+0000","last_deep_scrub":"79'246","last_deep_scrub_stamp":"2024-04-15T23:38:21.598451+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.598451+0000","objects_scrubbed":73,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:29:52.961528+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"53'173","reported_seq":538,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151146+0000","last_change":"2024-04-15T23:37:54.973693+0000","last_active":"2024-04-15T23:38:04.151146+0000","last_peered":"2024-04-15T23:38:04.151146+0000","last_clean":"2024-04-15T23:38:04.151146+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:04.151146+0000","last_undegraded":"2024-04-15T23:38:04.151146+0000","last_fullsized":"2024-04-15T23:38:04.151146+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"53'166","reported_seq":529,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150546+0000","last_change":"2024-04-15T23:37:54.972784+0000","last_active":"2024-04-15T23:38:04.150546+0000","last_peered":"2024-04-15T23:38:04.150546+0000","last_clean":"2024-04-15T23:38:04.150546+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:04.150546+0000","last_undegraded":"2024-04-15T23:38:04.150546+0000","last_fullsized":"2024-04-15T23:38:04.150546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"79'181","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.198939+0000","last_change":"2024-04-15T23:38:16.198976+0000","last_active":"2024-04-15T23:38:16.198939+0000","last_peered":"2024-04-15T23:38:16.198939+0000","last_clean":"2024-04-15T23:38:16.198939+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:16.198939+0000","last_undegraded":"2024-04-15T23:38:16.198939+0000","last_fullsized":"2024-04-15T23:38:16.198939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'181","last_scrub_stamp":"2024-04-15T23:38:16.198855+0000","last_deep_scrub":"79'181","last_deep_scrub_stamp":"2024-04-15T23:38:16.198855+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.198855+0000","objects_scrubbed":38,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:22:15.134238+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"79'223","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.911672+0000","last_change":"2024-04-15T23:38:15.911705+0000","last_active":"2024-04-15T23:38:15.911672+0000","last_peered":"2024-04-15T23:38:15.911672+0000","last_clean":"2024-04-15T23:38:15.911672+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:15.911672+0000","last_undegraded":"2024-04-15T23:38:15.911672+0000","last_fullsized":"2024-04-15T23:38:15.911672+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'223","last_scrub_stamp":"2024-04-15T23:38:15.911586+0000","last_deep_scrub":"79'223","last_deep_scrub_stamp":"2024-04-15T23:38:15.911586+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.911586+0000","objects_scrubbed":56,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:16.333575+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"79'204","reported_seq":554,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.560503+0000","last_change":"2024-04-15T23:38:15.560530+0000","last_active":"2024-04-15T23:38:15.560503+0000","last_peered":"2024-04-15T23:38:15.560503+0000","last_clean":"2024-04-15T23:38:15.560503+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:15.560503+0000","last_undegraded":"2024-04-15T23:38:15.560503+0000","last_fullsized":"2024-04-15T23:38:15.560503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'204","last_scrub_stamp":"2024-04-15T23:38:15.560419+0000","last_deep_scrub":"79'204","last_deep_scrub_stamp":"2024-04-15T23:38:15.560419+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.560419+0000","objects_scrubbed":52,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:57.938678+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"53'151","reported_seq":496,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151207+0000","last_change":"2024-04-15T23:37:54.973084+0000","last_active":"2024-04-15T23:38:04.151207+0000","last_peered":"2024-04-15T23:38:04.151207+0000","last_clean":"2024-04-15T23:38:04.151207+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:04.151207+0000","last_undegraded":"2024-04-15T23:38:04.151207+0000","last_fullsized":"2024-04-15T23:38:04.151207+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"79'190","reported_seq":349,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.599681+0000","last_change":"2024-04-15T23:38:20.599730+0000","last_active":"2024-04-15T23:38:20.599681+0000","last_peered":"2024-04-15T23:38:20.599681+0000","last_clean":"2024-04-15T23:38:20.599681+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:20.599681+0000","last_undegraded":"2024-04-15T23:38:20.599681+0000","last_fullsized":"2024-04-15T23:38:20.599681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'190","last_scrub_stamp":"2024-04-15T23:38:20.599599+0000","last_deep_scrub":"79'190","last_deep_scrub_stamp":"2024-04-15T23:38:20.599599+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.599599+0000","objects_scrubbed":49,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:18:50.442189+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"79'185","reported_seq":523,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.554041+0000","last_change":"2024-04-15T23:38:25.554098+0000","last_active":"2024-04-15T23:38:25.554041+0000","last_peered":"2024-04-15T23:38:25.554041+0000","last_clean":"2024-04-15T23:38:25.554041+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:25.554041+0000","last_undegraded":"2024-04-15T23:38:25.554041+0000","last_fullsized":"2024-04-15T23:38:25.554041+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'185","last_scrub_stamp":"2024-04-15T23:38:25.553900+0000","last_deep_scrub":"79'185","last_deep_scrub_stamp":"2024-04-15T23:38:25.553900+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.553900+0000","objects_scrubbed":50,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:46:37.589815+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"53'177","reported_seq":289,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150944+0000","last_change":"2024-04-15T23:37:54.981530+0000","last_active":"2024-04-15T23:38:04.150944+0000","last_peered":"2024-04-15T23:38:04.150944+0000","last_clean":"2024-04-15T23:38:04.150944+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:04.150944+0000","last_undegraded":"2024-04-15T23:38:04.150944+0000","last_fullsized":"2024-04-15T23:38:04.150944+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"53'157","reported_seq":264,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150387+0000","last_change":"2024-04-15T23:37:54.979318+0000","last_active":"2024-04-15T23:38:04.150387+0000","last_peered":"2024-04-15T23:38:04.150387+0000","last_clean":"2024-04-15T23:38:04.150387+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:04.150387+0000","last_undegraded":"2024-04-15T23:38:04.150387+0000","last_fullsized":"2024-04-15T23:38:04.150387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"79'235","reported_seq":616,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.239095+0000","last_change":"2024-04-15T23:38:25.239126+0000","last_active":"2024-04-15T23:38:25.239095+0000","last_peered":"2024-04-15T23:38:25.239095+0000","last_clean":"2024-04-15T23:38:25.239095+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:25.239095+0000","last_undegraded":"2024-04-15T23:38:25.239095+0000","last_fullsized":"2024-04-15T23:38:25.239095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'235","last_scrub_stamp":"2024-04-15T23:38:25.239007+0000","last_deep_scrub":"79'235","last_deep_scrub_stamp":"2024-04-15T23:38:25.239007+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.239007+0000","objects_scrubbed":58,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:37:33.687493+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"79'210","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.916926+0000","last_change":"2024-04-15T23:38:19.917011+0000","last_active":"2024-04-15T23:38:19.916926+0000","last_peered":"2024-04-15T23:38:19.916926+0000","last_clean":"2024-04-15T23:38:19.916926+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:19.916926+0000","last_undegraded":"2024-04-15T23:38:19.916926+0000","last_fullsized":"2024-04-15T23:38:19.916926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:19.916824+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:19.916824+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.916824+0000","objects_scrubbed":45,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:32:11.979533+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"79'199","reported_seq":550,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.548557+0000","last_change":"2024-04-15T23:38:13.548615+0000","last_active":"2024-04-15T23:38:13.548557+0000","last_peered":"2024-04-15T23:38:13.548557+0000","last_clean":"2024-04-15T23:38:13.548557+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:13.548557+0000","last_undegraded":"2024-04-15T23:38:13.548557+0000","last_fullsized":"2024-04-15T23:38:13.548557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'199","last_scrub_stamp":"2024-04-15T23:38:13.548455+0000","last_deep_scrub":"79'199","last_deep_scrub_stamp":"2024-04-15T23:38:13.548455+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.548455+0000","objects_scrubbed":49,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:38:42.034985+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"79'202","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.876451+0000","last_change":"2024-04-15T23:38:14.876516+0000","last_active":"2024-04-15T23:38:14.876451+0000","last_peered":"2024-04-15T23:38:14.876451+0000","last_clean":"2024-04-15T23:38:14.876451+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:14.876451+0000","last_undegraded":"2024-04-15T23:38:14.876451+0000","last_fullsized":"2024-04-15T23:38:14.876451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:14.876346+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:14.876346+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.876346+0000","objects_scrubbed":58,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:05:20.121682+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"79'254","reported_seq":635,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.283040+0000","last_change":"2024-04-15T23:38:26.283108+0000","last_active":"2024-04-15T23:38:26.283040+0000","last_peered":"2024-04-15T23:38:26.283040+0000","last_clean":"2024-04-15T23:38:26.283040+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:26.283040+0000","last_undegraded":"2024-04-15T23:38:26.283040+0000","last_fullsized":"2024-04-15T23:38:26.283040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'254","last_scrub_stamp":"2024-04-15T23:38:26.282946+0000","last_deep_scrub":"79'254","last_deep_scrub_stamp":"2024-04-15T23:38:26.282946+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.282946+0000","objects_scrubbed":56,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:12:18.574118+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"79'216","reported_seq":581,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.217122+0000","last_change":"2024-04-15T23:38:18.217155+0000","last_active":"2024-04-15T23:38:18.217122+0000","last_peered":"2024-04-15T23:38:18.217122+0000","last_clean":"2024-04-15T23:38:18.217122+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:18.217122+0000","last_undegraded":"2024-04-15T23:38:18.217122+0000","last_fullsized":"2024-04-15T23:38:18.217122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:18.217043+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:18.217043+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.217043+0000","objects_scrubbed":54,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:34:28.568592+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"79'226","reported_seq":387,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:10.521308+0000","last_change":"2024-04-15T23:38:10.521308+0000","last_active":"2024-04-15T23:38:10.521308+0000","last_peered":"2024-04-15T23:38:10.521308+0000","last_clean":"2024-04-15T23:38:10.521308+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:10.521308+0000","last_undegraded":"2024-04-15T23:38:10.521308+0000","last_fullsized":"2024-04-15T23:38:10.521308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'226","last_scrub_stamp":"2024-04-15T23:38:10.521192+0000","last_deep_scrub":"79'226","last_deep_scrub_stamp":"2024-04-15T23:38:10.521192+0000","last_clean_scrub_stamp":"2024-04-15T23:38:10.521192+0000","objects_scrubbed":56,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:16:05.818704+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"79'211","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.815788+0000","last_change":"2024-04-15T23:38:24.815832+0000","last_active":"2024-04-15T23:38:24.815788+0000","last_peered":"2024-04-15T23:38:24.815788+0000","last_clean":"2024-04-15T23:38:24.815788+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:24.815788+0000","last_undegraded":"2024-04-15T23:38:24.815788+0000","last_fullsized":"2024-04-15T23:38:24.815788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:24.815711+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:24.815711+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.815711+0000","objects_scrubbed":49,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:17.481087+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"53'165","reported_seq":530,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054348+0000","last_change":"2024-04-15T23:35:10.299257+0000","last_active":"2024-04-15T23:38:04.054348+0000","last_peered":"2024-04-15T23:38:04.054348+0000","last_clean":"2024-04-15T23:38:04.054348+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:04.054348+0000","last_undegraded":"2024-04-15T23:38:04.054348+0000","last_fullsized":"2024-04-15T23:38:04.054348+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"79'215","reported_seq":376,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.531291+0000","last_change":"2024-04-15T23:38:14.531324+0000","last_active":"2024-04-15T23:38:14.531291+0000","last_peered":"2024-04-15T23:38:14.531291+0000","last_clean":"2024-04-15T23:38:14.531291+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:14.531291+0000","last_undegraded":"2024-04-15T23:38:14.531291+0000","last_fullsized":"2024-04-15T23:38:14.531291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:14.531213+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:14.531213+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.531213+0000","objects_scrubbed":59,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:23.389467+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"53'190","reported_seq":306,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055407+0000","last_change":"2024-04-15T23:37:54.973563+0000","last_active":"2024-04-15T23:38:04.055407+0000","last_peered":"2024-04-15T23:38:04.055407+0000","last_clean":"2024-04-15T23:38:04.055407+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:04.055407+0000","last_undegraded":"2024-04-15T23:38:04.055407+0000","last_fullsized":"2024-04-15T23:38:04.055407+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"53'160","reported_seq":268,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151225+0000","last_change":"2024-04-15T23:37:54.983757+0000","last_active":"2024-04-15T23:38:04.151225+0000","last_peered":"2024-04-15T23:38:04.151225+0000","last_clean":"2024-04-15T23:38:04.151225+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:04.151225+0000","last_undegraded":"2024-04-15T23:38:04.151225+0000","last_fullsized":"2024-04-15T23:38:04.151225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"53'151","reported_seq":302,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055114+0000","last_change":"2024-04-15T23:37:54.980987+0000","last_active":"2024-04-15T23:38:04.055114+0000","last_peered":"2024-04-15T23:38:04.055114+0000","last_clean":"2024-04-15T23:38:04.055114+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:04.055114+0000","last_undegraded":"2024-04-15T23:38:04.055114+0000","last_fullsized":"2024-04-15T23:38:04.055114+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"79'222","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.934383+0000","last_change":"2024-04-15T23:38:12.934414+0000","last_active":"2024-04-15T23:38:12.934383+0000","last_peered":"2024-04-15T23:38:12.934383+0000","last_clean":"2024-04-15T23:38:12.934383+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:12.934383+0000","last_undegraded":"2024-04-15T23:38:12.934383+0000","last_fullsized":"2024-04-15T23:38:12.934383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'222","last_scrub_stamp":"2024-04-15T23:38:12.934301+0000","last_deep_scrub":"79'222","last_deep_scrub_stamp":"2024-04-15T23:38:12.934301+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.934301+0000","objects_scrubbed":55,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:53:01.608980+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"53'193","reported_seq":344,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054773+0000","last_change":"2024-04-15T23:37:54.984225+0000","last_active":"2024-04-15T23:38:04.054773+0000","last_peered":"2024-04-15T23:38:04.054773+0000","last_clean":"2024-04-15T23:38:04.054773+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:04.054773+0000","last_undegraded":"2024-04-15T23:38:04.054773+0000","last_fullsized":"2024-04-15T23:38:04.054773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"53'186","reported_seq":307,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054790+0000","last_change":"2024-04-15T23:35:10.299527+0000","last_active":"2024-04-15T23:38:04.054790+0000","last_peered":"2024-04-15T23:38:04.054790+0000","last_clean":"2024-04-15T23:38:04.054790+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:04.054790+0000","last_undegraded":"2024-04-15T23:38:04.054790+0000","last_fullsized":"2024-04-15T23:38:04.054790+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"79'242","reported_seq":629,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.188900+0000","last_change":"2024-04-15T23:38:13.188939+0000","last_active":"2024-04-15T23:38:13.188900+0000","last_peered":"2024-04-15T23:38:13.188900+0000","last_clean":"2024-04-15T23:38:13.188900+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:13.188900+0000","last_undegraded":"2024-04-15T23:38:13.188900+0000","last_fullsized":"2024-04-15T23:38:13.188900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'242","last_scrub_stamp":"2024-04-15T23:38:13.188813+0000","last_deep_scrub":"79'242","last_deep_scrub_stamp":"2024-04-15T23:38:13.188813+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.188813+0000","objects_scrubbed":61,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:32:30.280122+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"79'199","reported_seq":548,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.598029+0000","last_change":"2024-04-15T23:38:23.598089+0000","last_active":"2024-04-15T23:38:23.598029+0000","last_peered":"2024-04-15T23:38:23.598029+0000","last_clean":"2024-04-15T23:38:23.598029+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:23.598029+0000","last_undegraded":"2024-04-15T23:38:23.598029+0000","last_fullsized":"2024-04-15T23:38:23.598029+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'199","last_scrub_stamp":"2024-04-15T23:38:23.597922+0000","last_deep_scrub":"79'199","last_deep_scrub_stamp":"2024-04-15T23:38:23.597922+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.597922+0000","objects_scrubbed":46,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:51:09.121996+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"56'131","reported_seq":279,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150403+0000","last_change":"2024-04-15T23:37:54.974595+0000","last_active":"2024-04-15T23:38:04.150403+0000","last_peered":"2024-04-15T23:38:04.150403+0000","last_clean":"2024-04-15T23:38:04.150403+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:04.150403+0000","last_undegraded":"2024-04-15T23:38:04.150403+0000","last_fullsized":"2024-04-15T23:38:04.150403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"53'152","reported_seq":492,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055175+0000","last_change":"2024-04-15T23:35:12.300612+0000","last_active":"2024-04-15T23:38:04.055175+0000","last_peered":"2024-04-15T23:38:04.055175+0000","last_clean":"2024-04-15T23:38:04.055175+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:04.055175+0000","last_undegraded":"2024-04-15T23:38:04.055175+0000","last_fullsized":"2024-04-15T23:38:04.055175+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":69,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054547+0000","last_change":"2024-04-15T23:37:54.974511+0000","last_active":"2024-04-15T23:38:04.054547+0000","last_peered":"2024-04-15T23:38:04.054547+0000","last_clean":"2024-04-15T23:38:04.054547+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:04.054547+0000","last_undegraded":"2024-04-15T23:38:04.054547+0000","last_fullsized":"2024-04-15T23:38:04.054547+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"79'243","reported_seq":371,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.887241+0000","last_change":"2024-04-15T23:38:22.887269+0000","last_active":"2024-04-15T23:38:22.887241+0000","last_peered":"2024-04-15T23:38:22.887241+0000","last_clean":"2024-04-15T23:38:22.887241+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:22.887241+0000","last_undegraded":"2024-04-15T23:38:22.887241+0000","last_fullsized":"2024-04-15T23:38:22.887241+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'243","last_scrub_stamp":"2024-04-15T23:38:22.887161+0000","last_deep_scrub":"79'243","last_deep_scrub_stamp":"2024-04-15T23:38:22.887161+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.887161+0000","objects_scrubbed":51,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:43:24.550219+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":160,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.553952+0000","last_change":"2024-04-15T23:38:16.553977+0000","last_active":"2024-04-15T23:38:16.553952+0000","last_peered":"2024-04-15T23:38:16.553952+0000","last_clean":"2024-04-15T23:38:16.553952+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:16.553952+0000","last_undegraded":"2024-04-15T23:38:16.553952+0000","last_fullsized":"2024-04-15T23:38:16.553952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:16.553862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:16.553862+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.553862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:08:22.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"53'178","reported_seq":300,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055289+0000","last_change":"2024-04-15T23:37:54.974029+0000","last_active":"2024-04-15T23:38:04.055289+0000","last_peered":"2024-04-15T23:38:04.055289+0000","last_clean":"2024-04-15T23:38:04.055289+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:04.055289+0000","last_undegraded":"2024-04-15T23:38:04.055289+0000","last_fullsized":"2024-04-15T23:38:04.055289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"79'13","reported_seq":122,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.182671+0000","last_change":"2024-04-15T23:38:12.182714+0000","last_active":"2024-04-15T23:38:12.182671+0000","last_peered":"2024-04-15T23:38:12.182671+0000","last_clean":"2024-04-15T23:38:12.182671+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:12.182671+0000","last_undegraded":"2024-04-15T23:38:12.182671+0000","last_fullsized":"2024-04-15T23:38:12.182671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'13","last_scrub_stamp":"2024-04-15T23:38:12.182588+0000","last_deep_scrub":"79'13","last_deep_scrub_stamp":"2024-04-15T23:38:12.182588+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.182588+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:40:29.437300+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"14'1","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151291+0000","last_change":"2024-04-15T23:37:54.978353+0000","last_active":"2024-04-15T23:38:04.151291+0000","last_peered":"2024-04-15T23:38:04.151291+0000","last_clean":"2024-04-15T23:38:04.151291+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:04.151291+0000","last_undegraded":"2024-04-15T23:38:04.151291+0000","last_fullsized":"2024-04-15T23:38:04.151291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"79'209","reported_seq":370,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.568416+0000","last_change":"2024-04-15T23:38:12.568452+0000","last_active":"2024-04-15T23:38:12.568416+0000","last_peered":"2024-04-15T23:38:12.568416+0000","last_clean":"2024-04-15T23:38:12.568416+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:12.568416+0000","last_undegraded":"2024-04-15T23:38:12.568416+0000","last_fullsized":"2024-04-15T23:38:12.568416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'209","last_scrub_stamp":"2024-04-15T23:38:12.568335+0000","last_deep_scrub":"79'209","last_deep_scrub_stamp":"2024-04-15T23:38:12.568335+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.568335+0000","objects_scrubbed":56,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:16.914156+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"50'3","reported_seq":156,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:10.343742+0000","last_change":"2024-04-15T23:37:54.984099+0000","last_active":"2024-04-15T23:38:10.343742+0000","last_peered":"2024-04-15T23:38:10.343742+0000","last_clean":"2024-04-15T23:38:10.343742+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:10.343742+0000","last_undegraded":"2024-04-15T23:38:10.343742+0000","last_fullsized":"2024-04-15T23:38:10.343742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"53'177","reported_seq":567,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054454+0000","last_change":"2024-04-15T23:35:12.297175+0000","last_active":"2024-04-15T23:38:04.054454+0000","last_peered":"2024-04-15T23:38:04.054454+0000","last_clean":"2024-04-15T23:38:04.054454+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:04.054454+0000","last_undegraded":"2024-04-15T23:38:04.054454+0000","last_fullsized":"2024-04-15T23:38:04.054454+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"14'1","reported_seq":121,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151044+0000","last_change":"2024-04-15T23:37:54.982866+0000","last_active":"2024-04-15T23:38:04.151044+0000","last_peered":"2024-04-15T23:38:04.151044+0000","last_clean":"2024-04-15T23:38:04.151044+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:04.151044+0000","last_undegraded":"2024-04-15T23:38:04.151044+0000","last_fullsized":"2024-04-15T23:38:04.151044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"79'202","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.220318+0000","last_change":"2024-04-15T23:38:19.220351+0000","last_active":"2024-04-15T23:38:19.220318+0000","last_peered":"2024-04-15T23:38:19.220318+0000","last_clean":"2024-04-15T23:38:19.220318+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:19.220318+0000","last_undegraded":"2024-04-15T23:38:19.220318+0000","last_fullsized":"2024-04-15T23:38:19.220318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:19.220237+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:19.220237+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.220237+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:58:12.248305+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.190109+0000","last_change":"2024-04-15T23:38:22.190134+0000","last_active":"2024-04-15T23:38:22.190109+0000","last_peered":"2024-04-15T23:38:22.190109+0000","last_clean":"2024-04-15T23:38:22.190109+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:22.190109+0000","last_undegraded":"2024-04-15T23:38:22.190109+0000","last_fullsized":"2024-04-15T23:38:22.190109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'1","last_scrub_stamp":"2024-04-15T23:38:22.190022+0000","last_deep_scrub":"50'1","last_deep_scrub_stamp":"2024-04-15T23:38:22.190022+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.190022+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:51.403732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"53'156","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055277+0000","last_change":"2024-04-15T23:37:54.980344+0000","last_active":"2024-04-15T23:38:04.055277+0000","last_peered":"2024-04-15T23:38:04.055277+0000","last_clean":"2024-04-15T23:38:04.055277+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:04.055277+0000","last_undegraded":"2024-04-15T23:38:04.055277+0000","last_fullsized":"2024-04-15T23:38:04.055277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"49'7","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055070+0000","last_change":"2024-04-15T23:37:54.972806+0000","last_active":"2024-04-15T23:38:04.055070+0000","last_peered":"2024-04-15T23:38:04.055070+0000","last_clean":"2024-04-15T23:38:04.055070+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:04.055070+0000","last_undegraded":"2024-04-15T23:38:04.055070+0000","last_fullsized":"2024-04-15T23:38:04.055070+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"79'238","reported_seq":631,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.193816+0000","last_change":"2024-04-15T23:38:17.193855+0000","last_active":"2024-04-15T23:38:17.193816+0000","last_peered":"2024-04-15T23:38:17.193816+0000","last_clean":"2024-04-15T23:38:17.193816+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:17.193816+0000","last_undegraded":"2024-04-15T23:38:17.193816+0000","last_fullsized":"2024-04-15T23:38:17.193816+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'238","last_scrub_stamp":"2024-04-15T23:38:17.193722+0000","last_deep_scrub":"79'238","last_deep_scrub_stamp":"2024-04-15T23:38:17.193722+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.193722+0000","objects_scrubbed":58,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:26.910291+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.209663+0000","last_change":"2024-04-15T23:38:24.209687+0000","last_active":"2024-04-15T23:38:24.209663+0000","last_peered":"2024-04-15T23:38:24.209663+0000","last_clean":"2024-04-15T23:38:24.209663+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:24.209663+0000","last_undegraded":"2024-04-15T23:38:24.209663+0000","last_fullsized":"2024-04-15T23:38:24.209663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:24.209573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:24.209573+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.209573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:57:42.293988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"53'166","reported_seq":278,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150918+0000","last_change":"2024-04-15T23:37:54.983150+0000","last_active":"2024-04-15T23:38:04.150918+0000","last_peered":"2024-04-15T23:38:04.150918+0000","last_clean":"2024-04-15T23:38:04.150918+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:04.150918+0000","last_undegraded":"2024-04-15T23:38:04.150918+0000","last_fullsized":"2024-04-15T23:38:04.150918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.487326+0000","last_change":"2024-04-15T23:38:11.487368+0000","last_active":"2024-04-15T23:38:11.487326+0000","last_peered":"2024-04-15T23:38:11.487326+0000","last_clean":"2024-04-15T23:38:11.487326+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:11.487326+0000","last_undegraded":"2024-04-15T23:38:11.487326+0000","last_fullsized":"2024-04-15T23:38:11.487326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:11.487224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:11.487224+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.487224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:54:24.474774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"79'191","reported_seq":312,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.213138+0000","last_change":"2024-04-15T23:38:14.213167+0000","last_active":"2024-04-15T23:38:14.213138+0000","last_peered":"2024-04-15T23:38:14.213138+0000","last_clean":"2024-04-15T23:38:14.213138+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:14.213138+0000","last_undegraded":"2024-04-15T23:38:14.213138+0000","last_fullsized":"2024-04-15T23:38:14.213138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'191","last_scrub_stamp":"2024-04-15T23:38:14.213023+0000","last_deep_scrub":"79'191","last_deep_scrub_stamp":"2024-04-15T23:38:14.213023+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.213023+0000","objects_scrubbed":53,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:01:47.573046+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":154,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054504+0000","last_change":"2024-04-15T23:35:07.909057+0000","last_active":"2024-04-15T23:38:04.054504+0000","last_peered":"2024-04-15T23:38:04.054504+0000","last_clean":"2024-04-15T23:38:04.054504+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:04.054504+0000","last_undegraded":"2024-04-15T23:38:04.054504+0000","last_fullsized":"2024-04-15T23:38:04.054504+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"79'192","reported_seq":316,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.956276+0000","last_change":"2024-04-15T23:38:17.956327+0000","last_active":"2024-04-15T23:38:17.956276+0000","last_peered":"2024-04-15T23:38:17.956276+0000","last_clean":"2024-04-15T23:38:17.956276+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:17.956276+0000","last_undegraded":"2024-04-15T23:38:17.956276+0000","last_fullsized":"2024-04-15T23:38:17.956276+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'192","last_scrub_stamp":"2024-04-15T23:38:17.956191+0000","last_deep_scrub":"79'192","last_deep_scrub_stamp":"2024-04-15T23:38:17.956191+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.956191+0000","objects_scrubbed":47,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:08:43.386809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":324,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.150976+0000","last_change":"2024-04-15T23:38:15.151005+0000","last_active":"2024-04-15T23:38:15.150976+0000","last_peered":"2024-04-15T23:38:15.150976+0000","last_clean":"2024-04-15T23:38:15.150976+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:15.150976+0000","last_undegraded":"2024-04-15T23:38:15.150976+0000","last_fullsized":"2024-04-15T23:38:15.150976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-15T23:38:15.150888+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-15T23:38:15.150888+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.150888+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:50:53.833085+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.162983+0000","last_change":"2024-04-15T23:38:21.163009+0000","last_active":"2024-04-15T23:38:21.162983+0000","last_peered":"2024-04-15T23:38:21.162983+0000","last_clean":"2024-04-15T23:38:21.162983+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:21.162983+0000","last_undegraded":"2024-04-15T23:38:21.162983+0000","last_fullsized":"2024-04-15T23:38:21.162983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:21.162886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:21.162886+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.162886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:32:05.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054863+0000","last_change":"2024-04-15T23:35:07.910739+0000","last_active":"2024-04-15T23:38:04.054863+0000","last_peered":"2024-04-15T23:38:04.054863+0000","last_clean":"2024-04-15T23:38:04.054863+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:04.054863+0000","last_undegraded":"2024-04-15T23:38:04.054863+0000","last_fullsized":"2024-04-15T23:38:04.054863+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"53'151","reported_seq":263,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151094+0000","last_change":"2024-04-15T23:37:54.983413+0000","last_active":"2024-04-15T23:38:04.151094+0000","last_peered":"2024-04-15T23:38:04.151094+0000","last_clean":"2024-04-15T23:38:04.151094+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:04.151094+0000","last_undegraded":"2024-04-15T23:38:04.151094+0000","last_fullsized":"2024-04-15T23:38:04.151094+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.201845+0000","last_change":"2024-04-15T23:38:11.201867+0000","last_active":"2024-04-15T23:38:11.201845+0000","last_peered":"2024-04-15T23:38:11.201845+0000","last_clean":"2024-04-15T23:38:11.201845+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:11.201845+0000","last_undegraded":"2024-04-15T23:38:11.201845+0000","last_fullsized":"2024-04-15T23:38:11.201845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:11.201750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:11.201750+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.201750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:38:43.306147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'36","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.930002+0000","last_change":"2024-04-15T23:38:18.930031+0000","last_active":"2024-04-15T23:38:18.930002+0000","last_peered":"2024-04-15T23:38:18.930002+0000","last_clean":"2024-04-15T23:38:18.930002+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:18.930002+0000","last_undegraded":"2024-04-15T23:38:18.930002+0000","last_fullsized":"2024-04-15T23:38:18.930002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'36","last_scrub_stamp":"2024-04-15T23:38:18.929917+0000","last_deep_scrub":"79'36","last_deep_scrub_stamp":"2024-04-15T23:38:18.929917+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.929917+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:48:20.198030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"79'216","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.599326+0000","last_change":"2024-04-15T23:38:19.599364+0000","last_active":"2024-04-15T23:38:19.599326+0000","last_peered":"2024-04-15T23:38:19.599326+0000","last_clean":"2024-04-15T23:38:19.599326+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:19.599326+0000","last_undegraded":"2024-04-15T23:38:19.599326+0000","last_fullsized":"2024-04-15T23:38:19.599326+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:19.599234+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:19.599234+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.599234+0000","objects_scrubbed":57,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:56:14.976800+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054568+0000","last_change":"2024-04-15T23:35:07.908488+0000","last_active":"2024-04-15T23:38:04.054568+0000","last_peered":"2024-04-15T23:38:04.054568+0000","last_clean":"2024-04-15T23:38:04.054568+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:04.054568+0000","last_undegraded":"2024-04-15T23:38:04.054568+0000","last_fullsized":"2024-04-15T23:38:04.054568+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'57","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.546341+0000","last_change":"2024-04-15T23:38:22.546399+0000","last_active":"2024-04-15T23:38:22.546341+0000","last_peered":"2024-04-15T23:38:22.546341+0000","last_clean":"2024-04-15T23:38:22.546341+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:22.546341+0000","last_undegraded":"2024-04-15T23:38:22.546341+0000","last_fullsized":"2024-04-15T23:38:22.546341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'57","last_scrub_stamp":"2024-04-15T23:38:22.546216+0000","last_deep_scrub":"79'57","last_deep_scrub_stamp":"2024-04-15T23:38:22.546216+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.546216+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:55:52.662990+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"79'221","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.873315+0000","last_change":"2024-04-15T23:38:21.873345+0000","last_active":"2024-04-15T23:38:21.873315+0000","last_peered":"2024-04-15T23:38:21.873315+0000","last_clean":"2024-04-15T23:38:21.873315+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:21.873315+0000","last_undegraded":"2024-04-15T23:38:21.873315+0000","last_fullsized":"2024-04-15T23:38:21.873315+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'221","last_scrub_stamp":"2024-04-15T23:38:21.873225+0000","last_deep_scrub":"79'221","last_deep_scrub_stamp":"2024-04-15T23:38:21.873225+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.873225+0000","objects_scrubbed":57,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:07:35.908985+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.169337+0000","last_change":"2024-04-15T23:38:20.169363+0000","last_active":"2024-04-15T23:38:20.169337+0000","last_peered":"2024-04-15T23:38:20.169337+0000","last_clean":"2024-04-15T23:38:20.169337+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:20.169337+0000","last_undegraded":"2024-04-15T23:38:20.169337+0000","last_fullsized":"2024-04-15T23:38:20.169337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:20.169233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:20.169233+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.169233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:18:09.381116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.211257+0000","last_change":"2024-04-15T23:38:23.211296+0000","last_active":"2024-04-15T23:38:23.211257+0000","last_peered":"2024-04-15T23:38:23.211257+0000","last_clean":"2024-04-15T23:38:23.211257+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:23.211257+0000","last_undegraded":"2024-04-15T23:38:23.211257+0000","last_fullsized":"2024-04-15T23:38:23.211257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:23.211170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:23.211170+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.211170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:30.223970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"79'211","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.907948+0000","last_change":"2024-04-15T23:38:13.907976+0000","last_active":"2024-04-15T23:38:13.907948+0000","last_peered":"2024-04-15T23:38:13.907948+0000","last_clean":"2024-04-15T23:38:13.907948+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:13.907948+0000","last_undegraded":"2024-04-15T23:38:13.907948+0000","last_fullsized":"2024-04-15T23:38:13.907948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:13.907868+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:13.907868+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.907868+0000","objects_scrubbed":54,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:04:37.554420+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150635+0000","last_change":"2024-04-15T23:37:54.973662+0000","last_active":"2024-04-15T23:38:04.150635+0000","last_peered":"2024-04-15T23:38:04.150635+0000","last_clean":"2024-04-15T23:38:04.150635+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:04.150635+0000","last_undegraded":"2024-04-15T23:38:04.150635+0000","last_fullsized":"2024-04-15T23:38:04.150635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054689+0000","last_change":"2024-04-15T23:35:07.908407+0000","last_active":"2024-04-15T23:38:04.054689+0000","last_peered":"2024-04-15T23:38:04.054689+0000","last_clean":"2024-04-15T23:38:04.054689+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:04.054689+0000","last_undegraded":"2024-04-15T23:38:04.054689+0000","last_fullsized":"2024-04-15T23:38:04.054689+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"53'211","reported_seq":362,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054592+0000","last_change":"2024-04-15T23:37:54.980334+0000","last_active":"2024-04-15T23:38:04.054592+0000","last_peered":"2024-04-15T23:38:04.054592+0000","last_clean":"2024-04-15T23:38:04.054592+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:04.054592+0000","last_undegraded":"2024-04-15T23:38:04.054592+0000","last_fullsized":"2024-04-15T23:38:04.054592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054886+0000","last_change":"2024-04-15T23:35:07.908916+0000","last_active":"2024-04-15T23:38:04.054886+0000","last_peered":"2024-04-15T23:38:04.054886+0000","last_clean":"2024-04-15T23:38:04.054886+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:04.054886+0000","last_undegraded":"2024-04-15T23:38:04.054886+0000","last_fullsized":"2024-04-15T23:38:04.054886+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.614971+0000","last_change":"2024-04-15T23:38:28.615047+0000","last_active":"2024-04-15T23:38:28.614971+0000","last_peered":"2024-04-15T23:38:28.614971+0000","last_clean":"2024-04-15T23:38:28.614971+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:28.614971+0000","last_undegraded":"2024-04-15T23:38:28.614971+0000","last_fullsized":"2024-04-15T23:38:28.614971+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:28.614855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:28.614855+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.614855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:04:30.732928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"79'233","reported_seq":394,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.607055+0000","last_change":"2024-04-15T23:38:26.607087+0000","last_active":"2024-04-15T23:38:26.607055+0000","last_peered":"2024-04-15T23:38:26.607055+0000","last_clean":"2024-04-15T23:38:26.607055+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:26.607055+0000","last_undegraded":"2024-04-15T23:38:26.607055+0000","last_fullsized":"2024-04-15T23:38:26.607055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'233","last_scrub_stamp":"2024-04-15T23:38:26.606966+0000","last_deep_scrub":"79'233","last_deep_scrub_stamp":"2024-04-15T23:38:26.606966+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.606966+0000","objects_scrubbed":53,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:39.151099+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"14'2","reported_seq":66,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055334+0000","last_change":"2024-04-15T23:35:07.910811+0000","last_active":"2024-04-15T23:38:04.055334+0000","last_peered":"2024-04-15T23:38:04.055334+0000","last_clean":"2024-04-15T23:38:04.055334+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:04.055334+0000","last_undegraded":"2024-04-15T23:38:04.055334+0000","last_fullsized":"2024-04-15T23:38:04.055334+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055078+0000","last_change":"2024-04-15T23:35:07.909109+0000","last_active":"2024-04-15T23:38:04.055078+0000","last_peered":"2024-04-15T23:38:04.055078+0000","last_clean":"2024-04-15T23:38:04.055078+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:04.055078+0000","last_undegraded":"2024-04-15T23:38:04.055078+0000","last_fullsized":"2024-04-15T23:38:04.055078+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:24.576473+0000","last_clean_scrub_stamp":"2024-04-15T23:31:24.576473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"53'155","reported_seq":277,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054506+0000","last_change":"2024-04-15T23:37:54.980077+0000","last_active":"2024-04-15T23:38:04.054506+0000","last_peered":"2024-04-15T23:38:04.054506+0000","last_clean":"2024-04-15T23:38:04.054506+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:04.054506+0000","last_undegraded":"2024-04-15T23:38:04.054506+0000","last_fullsized":"2024-04-15T23:38:04.054506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'37","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.920225+0000","last_change":"2024-04-15T23:38:16.920251+0000","last_active":"2024-04-15T23:38:16.920225+0000","last_peered":"2024-04-15T23:38:16.920225+0000","last_clean":"2024-04-15T23:38:16.920225+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:16.920225+0000","last_undegraded":"2024-04-15T23:38:16.920225+0000","last_fullsized":"2024-04-15T23:38:16.920225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'37","last_scrub_stamp":"2024-04-15T23:38:16.920141+0000","last_deep_scrub":"79'37","last_deep_scrub_stamp":"2024-04-15T23:38:16.920141+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.920141+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:05:28.389525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.224776+0000","last_change":"2024-04-15T23:38:27.224802+0000","last_active":"2024-04-15T23:38:27.224776+0000","last_peered":"2024-04-15T23:38:27.224776+0000","last_clean":"2024-04-15T23:38:27.224776+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:27.224776+0000","last_undegraded":"2024-04-15T23:38:27.224776+0000","last_fullsized":"2024-04-15T23:38:27.224776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:27.224626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:27.224626+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.224626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:02.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"79'191","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.584056+0000","last_change":"2024-04-15T23:38:24.584113+0000","last_active":"2024-04-15T23:38:24.584056+0000","last_peered":"2024-04-15T23:38:24.584056+0000","last_clean":"2024-04-15T23:38:24.584056+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:24.584056+0000","last_undegraded":"2024-04-15T23:38:24.584056+0000","last_fullsized":"2024-04-15T23:38:24.584056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'191","last_scrub_stamp":"2024-04-15T23:38:24.583969+0000","last_deep_scrub":"79'191","last_deep_scrub_stamp":"2024-04-15T23:38:24.583969+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.583969+0000","objects_scrubbed":49,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:30:23.632335+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"53'155","reported_seq":262,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150835+0000","last_change":"2024-04-15T23:37:54.980622+0000","last_active":"2024-04-15T23:38:04.150835+0000","last_peered":"2024-04-15T23:38:04.150835+0000","last_clean":"2024-04-15T23:38:04.150835+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:04.150835+0000","last_undegraded":"2024-04-15T23:38:04.150835+0000","last_fullsized":"2024-04-15T23:38:04.150835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"56'43","reported_seq":164,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150487+0000","last_change":"2024-04-15T23:37:54.978365+0000","last_active":"2024-04-15T23:38:04.150487+0000","last_peered":"2024-04-15T23:38:04.150487+0000","last_clean":"2024-04-15T23:38:04.150487+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:04.150487+0000","last_undegraded":"2024-04-15T23:38:04.150487+0000","last_fullsized":"2024-04-15T23:38:04.150487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"79'202","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.847512+0000","last_change":"2024-04-15T23:38:23.847575+0000","last_active":"2024-04-15T23:38:23.847512+0000","last_peered":"2024-04-15T23:38:23.847512+0000","last_clean":"2024-04-15T23:38:23.847512+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:23.847512+0000","last_undegraded":"2024-04-15T23:38:23.847512+0000","last_fullsized":"2024-04-15T23:38:23.847512+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:23.847415+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:23.847415+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.847415+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:00:40.815243+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"51'23","reported_seq":175,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055337+0000","last_change":"2024-04-15T23:37:54.985535+0000","last_active":"2024-04-15T23:38:04.055337+0000","last_peered":"2024-04-15T23:38:04.055337+0000","last_clean":"2024-04-15T23:38:04.055337+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:04.055337+0000","last_undegraded":"2024-04-15T23:38:04.055337+0000","last_fullsized":"2024-04-15T23:38:04.055337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":135,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150995+0000","last_change":"2024-04-15T23:37:54.968102+0000","last_active":"2024-04-15T23:38:04.150995+0000","last_peered":"2024-04-15T23:38:04.150995+0000","last_clean":"2024-04-15T23:38:04.150995+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:04.150995+0000","last_undegraded":"2024-04-15T23:38:04.150995+0000","last_fullsized":"2024-04-15T23:38:04.150995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"53'172","reported_seq":300,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054634+0000","last_change":"2024-04-15T23:37:54.974948+0000","last_active":"2024-04-15T23:38:04.054634+0000","last_peered":"2024-04-15T23:38:04.054634+0000","last_clean":"2024-04-15T23:38:04.054634+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:04.054634+0000","last_undegraded":"2024-04-15T23:38:04.054634+0000","last_fullsized":"2024-04-15T23:38:04.054634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.911580+0000","last_change":"2024-04-15T23:38:11.911623+0000","last_active":"2024-04-15T23:38:11.911580+0000","last_peered":"2024-04-15T23:38:11.911580+0000","last_clean":"2024-04-15T23:38:11.911580+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:11.911580+0000","last_undegraded":"2024-04-15T23:38:11.911580+0000","last_fullsized":"2024-04-15T23:38:11.911580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2024-04-15T23:38:11.911437+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2024-04-15T23:38:11.911437+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.911437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:07.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"79'209","reported_seq":340,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.805793+0000","last_change":"2024-04-15T23:38:25.805819+0000","last_active":"2024-04-15T23:38:25.805793+0000","last_peered":"2024-04-15T23:38:25.805793+0000","last_clean":"2024-04-15T23:38:25.805793+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:25.805793+0000","last_undegraded":"2024-04-15T23:38:25.805793+0000","last_fullsized":"2024-04-15T23:38:25.805793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'209","last_scrub_stamp":"2024-04-15T23:38:25.805715+0000","last_deep_scrub":"79'209","last_deep_scrub_stamp":"2024-04-15T23:38:25.805715+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.805715+0000","objects_scrubbed":50,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:04:19.023092+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"53'171","reported_seq":322,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055567+0000","last_change":"2024-04-15T23:37:54.984384+0000","last_active":"2024-04-15T23:38:04.055567+0000","last_peered":"2024-04-15T23:38:04.055567+0000","last_clean":"2024-04-15T23:38:04.055567+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:04.055567+0000","last_undegraded":"2024-04-15T23:38:04.055567+0000","last_fullsized":"2024-04-15T23:38:04.055567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":62,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054225+0000","last_change":"2024-04-15T23:35:07.907643+0000","last_active":"2024-04-15T23:38:04.054225+0000","last_peered":"2024-04-15T23:38:04.054225+0000","last_clean":"2024-04-15T23:38:04.054225+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:04.054225+0000","last_undegraded":"2024-04-15T23:38:04.054225+0000","last_fullsized":"2024-04-15T23:38:04.054225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"53'157","reported_seq":273,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055331+0000","last_change":"2024-04-15T23:37:54.973548+0000","last_active":"2024-04-15T23:38:04.055331+0000","last_peered":"2024-04-15T23:38:04.055331+0000","last_clean":"2024-04-15T23:38:04.055331+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:04.055331+0000","last_undegraded":"2024-04-15T23:38:04.055331+0000","last_fullsized":"2024-04-15T23:38:04.055331+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.873570+0000","last_change":"2024-04-15T23:38:20.873620+0000","last_active":"2024-04-15T23:38:20.873570+0000","last_peered":"2024-04-15T23:38:20.873570+0000","last_clean":"2024-04-15T23:38:20.873570+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:20.873570+0000","last_undegraded":"2024-04-15T23:38:20.873570+0000","last_fullsized":"2024-04-15T23:38:20.873570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:20.873470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:20.873470+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.873470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:49:50.516057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"53'148","reported_seq":298,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054907+0000","last_change":"2024-04-15T23:37:54.979923+0000","last_active":"2024-04-15T23:38:04.054907+0000","last_peered":"2024-04-15T23:38:04.054907+0000","last_clean":"2024-04-15T23:38:04.054907+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:04.054907+0000","last_undegraded":"2024-04-15T23:38:04.054907+0000","last_fullsized":"2024-04-15T23:38:04.054907+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"46'2","reported_seq":159,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054931+0000","last_change":"2024-04-15T23:35:07.932913+0000","last_active":"2024-04-15T23:38:04.054931+0000","last_peered":"2024-04-15T23:38:04.054931+0000","last_clean":"2024-04-15T23:38:04.054931+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:04.054931+0000","last_undegraded":"2024-04-15T23:38:04.054931+0000","last_fullsized":"2024-04-15T23:38:04.054931+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"53'160","reported_seq":522,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054748+0000","last_change":"2024-04-15T23:35:13.298781+0000","last_active":"2024-04-15T23:38:04.054748+0000","last_peered":"2024-04-15T23:38:04.054748+0000","last_clean":"2024-04-15T23:38:04.054748+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:04.054748+0000","last_undegraded":"2024-04-15T23:38:04.054748+0000","last_fullsized":"2024-04-15T23:38:04.054748+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"79'6","reported_seq":166,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.527158+0000","last_change":"2024-04-15T23:38:18.527190+0000","last_active":"2024-04-15T23:38:18.527158+0000","last_peered":"2024-04-15T23:38:18.527158+0000","last_clean":"2024-04-15T23:38:18.527158+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:18.527158+0000","last_undegraded":"2024-04-15T23:38:18.527158+0000","last_fullsized":"2024-04-15T23:38:18.527158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-15T23:38:18.527070+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-15T23:38:18.527070+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.527070+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:03:39.532930+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"53'163","reported_seq":518,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150940+0000","last_change":"2024-04-15T23:37:54.974223+0000","last_active":"2024-04-15T23:38:04.150940+0000","last_peered":"2024-04-15T23:38:04.150940+0000","last_clean":"2024-04-15T23:38:04.150940+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:04.150940+0000","last_undegraded":"2024-04-15T23:38:04.150940+0000","last_fullsized":"2024-04-15T23:38:04.150940+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"14'2","reported_seq":137,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150553+0000","last_change":"2024-04-15T23:37:54.970274+0000","last_active":"2024-04-15T23:38:04.150553+0000","last_peered":"2024-04-15T23:38:04.150553+0000","last_clean":"2024-04-15T23:38:04.150553+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:04.150553+0000","last_undegraded":"2024-04-15T23:38:04.150553+0000","last_fullsized":"2024-04-15T23:38:04.150553+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"53'159","reported_seq":508,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150478+0000","last_change":"2024-04-15T23:37:54.973213+0000","last_active":"2024-04-15T23:38:04.150478+0000","last_peered":"2024-04-15T23:38:04.150478+0000","last_clean":"2024-04-15T23:38:04.150478+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:04.150478+0000","last_undegraded":"2024-04-15T23:38:04.150478+0000","last_fullsized":"2024-04-15T23:38:04.150478+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"49'59","reported_seq":211,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055217+0000","last_change":"2024-04-15T23:37:54.985533+0000","last_active":"2024-04-15T23:38:04.055217+0000","last_peered":"2024-04-15T23:38:04.055217+0000","last_clean":"2024-04-15T23:38:04.055217+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:04.055217+0000","last_undegraded":"2024-04-15T23:38:04.055217+0000","last_fullsized":"2024-04-15T23:38:04.055217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"53'167","reported_seq":533,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.054832+0000","last_change":"2024-04-15T23:35:11.295105+0000","last_active":"2024-04-15T23:38:04.054832+0000","last_peered":"2024-04-15T23:38:04.054832+0000","last_clean":"2024-04-15T23:38:04.054832+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:04.054832+0000","last_undegraded":"2024-04-15T23:38:04.054832+0000","last_fullsized":"2024-04-15T23:38:04.054832+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"46'2","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055476+0000","last_change":"2024-04-15T23:35:07.931654+0000","last_active":"2024-04-15T23:38:04.055476+0000","last_peered":"2024-04-15T23:38:04.055476+0000","last_clean":"2024-04-15T23:38:04.055476+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:04.055476+0000","last_undegraded":"2024-04-15T23:38:04.055476+0000","last_fullsized":"2024-04-15T23:38:04.055476+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"53'189","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.150554+0000","last_change":"2024-04-15T23:37:54.973742+0000","last_active":"2024-04-15T23:38:04.150554+0000","last_peered":"2024-04-15T23:38:04.150554+0000","last_clean":"2024-04-15T23:38:04.150554+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:04.150554+0000","last_undegraded":"2024-04-15T23:38:04.150554+0000","last_fullsized":"2024-04-15T23:38:04.150554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"46'9","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.055216+0000","last_change":"2024-04-15T23:37:54.971964+0000","last_active":"2024-04-15T23:38:04.055216+0000","last_peered":"2024-04-15T23:38:04.055216+0000","last_clean":"2024-04-15T23:38:04.055216+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:04.055216+0000","last_undegraded":"2024-04-15T23:38:04.055216+0000","last_fullsized":"2024-04-15T23:38:04.055216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:28.849203+0000","last_clean_scrub_stamp":"2024-04-15T23:31:28.849203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12180,"ondisk_log_size":12180,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103210,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72924,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94298916,"statfs":{"total":96636764160,"available":96562089984,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":28173543},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645321,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80976,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":28411,"kb_avail":94290864,"statfs":{"total":96636764160,"available":96553844736,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":29093251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93080,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94278760,"statfs":{"total":96636764160,"available":96541450240,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:31.870 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.870 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.871 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.871 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.871 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.871 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.871 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.872 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.872 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.872 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.872 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.872 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.872 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.873 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.873 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.873 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.873 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.873 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.873 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.874 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.874 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.874 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.874 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.874 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.875 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.875 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.875 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.875 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.875 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.876 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.877 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.877 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.877 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.878 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-15T23:31:24.576473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=24, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.878 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.878 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.878 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.878 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.879 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.879 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.879 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.879 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.879 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.879 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.880 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.880 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.880 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.880 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.880 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.881 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.881 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.881 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.881 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.881 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-15T23:31:28.849203+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=28, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:31.881 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T23:38:51.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:38:52.185 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:38:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:38:52.196 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2024-04-15T23:38:51.892259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14434,"ondisk_log_size":14434,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255300,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860220,"statfs":{"total":289910292480,"available":289648865280,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003013"},"pg_stats":[{"pgid":"4.3f","version":"79'211","reported_seq":576,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.630468+0000","last_change":"2024-04-15T23:38:27.630503+0000","last_active":"2024-04-15T23:38:27.630468+0000","last_peered":"2024-04-15T23:38:27.630468+0000","last_clean":"2024-04-15T23:38:27.630468+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:27.630468+0000","last_undegraded":"2024-04-15T23:38:27.630468+0000","last_fullsized":"2024-04-15T23:38:27.630468+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:27.630388+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:27.630388+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.630388+0000","objects_scrubbed":59,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:51:05.111250+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"79'198","reported_seq":552,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.571390+0000","last_change":"2024-04-15T23:38:17.571459+0000","last_active":"2024-04-15T23:38:17.571390+0000","last_peered":"2024-04-15T23:38:17.571390+0000","last_clean":"2024-04-15T23:38:17.571390+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:17.571390+0000","last_undegraded":"2024-04-15T23:38:17.571390+0000","last_fullsized":"2024-04-15T23:38:17.571390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'198","last_scrub_stamp":"2024-04-15T23:38:17.571310+0000","last_deep_scrub":"79'198","last_deep_scrub_stamp":"2024-04-15T23:38:17.571310+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.571310+0000","objects_scrubbed":48,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:50.447066+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"53'169","reported_seq":281,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:04.151313+0000","last_change":"2024-04-15T23:37:54.984064+0000","last_active":"2024-04-15T23:38:04.151313+0000","last_peered":"2024-04-15T23:38:04.151313+0000","last_clean":"2024-04-15T23:38:04.151313+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:04.151313+0000","last_undegraded":"2024-04-15T23:38:04.151313+0000","last_fullsized":"2024-04-15T23:38:04.151313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:31:29.854434+0000","last_clean_scrub_stamp":"2024-04-15T23:31:29.854434+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"79'176","reported_seq":504,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:35.262816+0000","last_change":"2024-04-15T23:38:35.262856+0000","last_active":"2024-04-15T23:38:35.262816+0000","last_peered":"2024-04-15T23:38:35.262816+0000","last_clean":"2024-04-15T23:38:35.262816+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:35.262816+0000","last_undegraded":"2024-04-15T23:38:35.262816+0000","last_fullsized":"2024-04-15T23:38:35.262816+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'176","last_scrub_stamp":"2024-04-15T23:38:35.262725+0000","last_deep_scrub":"79'176","last_deep_scrub_stamp":"2024-04-15T23:38:35.262725+0000","last_clean_scrub_stamp":"2024-04-15T23:38:35.262725+0000","objects_scrubbed":48,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:29:15.724758+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"79'246","reported_seq":652,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.598546+0000","last_change":"2024-04-15T23:38:21.598587+0000","last_active":"2024-04-15T23:38:21.598546+0000","last_peered":"2024-04-15T23:38:21.598546+0000","last_clean":"2024-04-15T23:38:21.598546+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:21.598546+0000","last_undegraded":"2024-04-15T23:38:21.598546+0000","last_fullsized":"2024-04-15T23:38:21.598546+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'246","last_scrub_stamp":"2024-04-15T23:38:21.598451+0000","last_deep_scrub":"79'246","last_deep_scrub_stamp":"2024-04-15T23:38:21.598451+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.598451+0000","objects_scrubbed":73,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:29:52.961528+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"79'224","reported_seq":599,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:40.158276+0000","last_change":"2024-04-15T23:38:40.158313+0000","last_active":"2024-04-15T23:38:40.158276+0000","last_peered":"2024-04-15T23:38:40.158276+0000","last_clean":"2024-04-15T23:38:40.158276+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:40.158276+0000","last_undegraded":"2024-04-15T23:38:40.158276+0000","last_fullsized":"2024-04-15T23:38:40.158276+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'224","last_scrub_stamp":"2024-04-15T23:38:40.158198+0000","last_deep_scrub":"79'224","last_deep_scrub_stamp":"2024-04-15T23:38:40.158198+0000","last_clean_scrub_stamp":"2024-04-15T23:38:40.158198+0000","objects_scrubbed":51,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:43:05.905755+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"79'225","reported_seq":598,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:36.284901+0000","last_change":"2024-04-15T23:38:36.284940+0000","last_active":"2024-04-15T23:38:36.284901+0000","last_peered":"2024-04-15T23:38:36.284901+0000","last_clean":"2024-04-15T23:38:36.284901+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:36.284901+0000","last_undegraded":"2024-04-15T23:38:36.284901+0000","last_fullsized":"2024-04-15T23:38:36.284901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'225","last_scrub_stamp":"2024-04-15T23:38:36.284812+0000","last_deep_scrub":"79'225","last_deep_scrub_stamp":"2024-04-15T23:38:36.284812+0000","last_clean_scrub_stamp":"2024-04-15T23:38:36.284812+0000","objects_scrubbed":59,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:22:05.742306+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"79'181","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.198939+0000","last_change":"2024-04-15T23:38:16.198976+0000","last_active":"2024-04-15T23:38:16.198939+0000","last_peered":"2024-04-15T23:38:16.198939+0000","last_clean":"2024-04-15T23:38:16.198939+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:16.198939+0000","last_undegraded":"2024-04-15T23:38:16.198939+0000","last_fullsized":"2024-04-15T23:38:16.198939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'181","last_scrub_stamp":"2024-04-15T23:38:16.198855+0000","last_deep_scrub":"79'181","last_deep_scrub_stamp":"2024-04-15T23:38:16.198855+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.198855+0000","objects_scrubbed":38,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:22:15.134238+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"79'223","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.911672+0000","last_change":"2024-04-15T23:38:15.911705+0000","last_active":"2024-04-15T23:38:15.911672+0000","last_peered":"2024-04-15T23:38:15.911672+0000","last_clean":"2024-04-15T23:38:15.911672+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:15.911672+0000","last_undegraded":"2024-04-15T23:38:15.911672+0000","last_fullsized":"2024-04-15T23:38:15.911672+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'223","last_scrub_stamp":"2024-04-15T23:38:15.911586+0000","last_deep_scrub":"79'223","last_deep_scrub_stamp":"2024-04-15T23:38:15.911586+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.911586+0000","objects_scrubbed":56,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:16.333575+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"79'204","reported_seq":555,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.560530+0000","last_change":"2024-04-15T23:38:15.560530+0000","last_active":"2024-04-15T23:38:15.560530+0000","last_peered":"2024-04-15T23:38:15.560530+0000","last_clean":"2024-04-15T23:38:15.560530+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:15.560530+0000","last_undegraded":"2024-04-15T23:38:15.560530+0000","last_fullsized":"2024-04-15T23:38:15.560530+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'204","last_scrub_stamp":"2024-04-15T23:38:15.560419+0000","last_deep_scrub":"79'204","last_deep_scrub_stamp":"2024-04-15T23:38:15.560419+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.560419+0000","objects_scrubbed":52,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:57.938678+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"79'212","reported_seq":567,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:37.244297+0000","last_change":"2024-04-15T23:38:37.244331+0000","last_active":"2024-04-15T23:38:37.244297+0000","last_peered":"2024-04-15T23:38:37.244297+0000","last_clean":"2024-04-15T23:38:37.244297+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:37.244297+0000","last_undegraded":"2024-04-15T23:38:37.244297+0000","last_fullsized":"2024-04-15T23:38:37.244297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'212","last_scrub_stamp":"2024-04-15T23:38:37.244219+0000","last_deep_scrub":"79'212","last_deep_scrub_stamp":"2024-04-15T23:38:37.244219+0000","last_clean_scrub_stamp":"2024-04-15T23:38:37.244219+0000","objects_scrubbed":61,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:35.664144+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"79'190","reported_seq":350,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.599730+0000","last_change":"2024-04-15T23:38:20.599730+0000","last_active":"2024-04-15T23:38:20.599730+0000","last_peered":"2024-04-15T23:38:20.599730+0000","last_clean":"2024-04-15T23:38:20.599730+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:20.599730+0000","last_undegraded":"2024-04-15T23:38:20.599730+0000","last_fullsized":"2024-04-15T23:38:20.599730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'190","last_scrub_stamp":"2024-04-15T23:38:20.599599+0000","last_deep_scrub":"79'190","last_deep_scrub_stamp":"2024-04-15T23:38:20.599599+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.599599+0000","objects_scrubbed":49,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:18:50.442189+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"79'185","reported_seq":524,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.554098+0000","last_change":"2024-04-15T23:38:25.554098+0000","last_active":"2024-04-15T23:38:25.554098+0000","last_peered":"2024-04-15T23:38:25.554098+0000","last_clean":"2024-04-15T23:38:25.554098+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:25.554098+0000","last_undegraded":"2024-04-15T23:38:25.554098+0000","last_fullsized":"2024-04-15T23:38:25.554098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'185","last_scrub_stamp":"2024-04-15T23:38:25.553900+0000","last_deep_scrub":"79'185","last_deep_scrub_stamp":"2024-04-15T23:38:25.553900+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.553900+0000","objects_scrubbed":50,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:46:37.589815+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"79'215","reported_seq":336,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:43.119624+0000","last_change":"2024-04-15T23:38:43.119662+0000","last_active":"2024-04-15T23:38:43.119624+0000","last_peered":"2024-04-15T23:38:43.119624+0000","last_clean":"2024-04-15T23:38:43.119624+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:43.119624+0000","last_undegraded":"2024-04-15T23:38:43.119624+0000","last_fullsized":"2024-04-15T23:38:43.119624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:43.119543+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:43.119543+0000","last_clean_scrub_stamp":"2024-04-15T23:38:43.119543+0000","objects_scrubbed":38,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:12:23.400119+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"79'210","reported_seq":327,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:41.182378+0000","last_change":"2024-04-15T23:38:41.182414+0000","last_active":"2024-04-15T23:38:41.182378+0000","last_peered":"2024-04-15T23:38:41.182378+0000","last_clean":"2024-04-15T23:38:41.182378+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:41.182378+0000","last_undegraded":"2024-04-15T23:38:41.182378+0000","last_fullsized":"2024-04-15T23:38:41.182378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:41.182303+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:41.182303+0000","last_clean_scrub_stamp":"2024-04-15T23:38:41.182303+0000","objects_scrubbed":53,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:00:43.323595+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"79'235","reported_seq":616,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.239095+0000","last_change":"2024-04-15T23:38:25.239126+0000","last_active":"2024-04-15T23:38:25.239095+0000","last_peered":"2024-04-15T23:38:25.239095+0000","last_clean":"2024-04-15T23:38:25.239095+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:25.239095+0000","last_undegraded":"2024-04-15T23:38:25.239095+0000","last_fullsized":"2024-04-15T23:38:25.239095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'235","last_scrub_stamp":"2024-04-15T23:38:25.239007+0000","last_deep_scrub":"79'235","last_deep_scrub_stamp":"2024-04-15T23:38:25.239007+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.239007+0000","objects_scrubbed":58,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:37:33.687493+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"79'210","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.916926+0000","last_change":"2024-04-15T23:38:19.917011+0000","last_active":"2024-04-15T23:38:19.916926+0000","last_peered":"2024-04-15T23:38:19.916926+0000","last_clean":"2024-04-15T23:38:19.916926+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:19.916926+0000","last_undegraded":"2024-04-15T23:38:19.916926+0000","last_fullsized":"2024-04-15T23:38:19.916926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:19.916824+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:19.916824+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.916824+0000","objects_scrubbed":45,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:32:11.979533+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"79'199","reported_seq":551,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.548615+0000","last_change":"2024-04-15T23:38:13.548615+0000","last_active":"2024-04-15T23:38:13.548615+0000","last_peered":"2024-04-15T23:38:13.548615+0000","last_clean":"2024-04-15T23:38:13.548615+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:13.548615+0000","last_undegraded":"2024-04-15T23:38:13.548615+0000","last_fullsized":"2024-04-15T23:38:13.548615+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'199","last_scrub_stamp":"2024-04-15T23:38:13.548455+0000","last_deep_scrub":"79'199","last_deep_scrub_stamp":"2024-04-15T23:38:13.548455+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.548455+0000","objects_scrubbed":49,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:38:42.034985+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"79'202","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.876451+0000","last_change":"2024-04-15T23:38:14.876516+0000","last_active":"2024-04-15T23:38:14.876451+0000","last_peered":"2024-04-15T23:38:14.876451+0000","last_clean":"2024-04-15T23:38:14.876451+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:14.876451+0000","last_undegraded":"2024-04-15T23:38:14.876451+0000","last_fullsized":"2024-04-15T23:38:14.876451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:14.876346+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:14.876346+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.876346+0000","objects_scrubbed":58,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:05:20.121682+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"79'254","reported_seq":635,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.283040+0000","last_change":"2024-04-15T23:38:26.283108+0000","last_active":"2024-04-15T23:38:26.283040+0000","last_peered":"2024-04-15T23:38:26.283040+0000","last_clean":"2024-04-15T23:38:26.283040+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:26.283040+0000","last_undegraded":"2024-04-15T23:38:26.283040+0000","last_fullsized":"2024-04-15T23:38:26.283040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'254","last_scrub_stamp":"2024-04-15T23:38:26.282946+0000","last_deep_scrub":"79'254","last_deep_scrub_stamp":"2024-04-15T23:38:26.282946+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.282946+0000","objects_scrubbed":56,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:12:18.574118+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"79'216","reported_seq":581,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.217122+0000","last_change":"2024-04-15T23:38:18.217155+0000","last_active":"2024-04-15T23:38:18.217122+0000","last_peered":"2024-04-15T23:38:18.217122+0000","last_clean":"2024-04-15T23:38:18.217122+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:18.217122+0000","last_undegraded":"2024-04-15T23:38:18.217122+0000","last_fullsized":"2024-04-15T23:38:18.217122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:18.217043+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:18.217043+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.217043+0000","objects_scrubbed":54,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:34:28.568592+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"79'226","reported_seq":387,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:10.521308+0000","last_change":"2024-04-15T23:38:10.521308+0000","last_active":"2024-04-15T23:38:10.521308+0000","last_peered":"2024-04-15T23:38:10.521308+0000","last_clean":"2024-04-15T23:38:10.521308+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:10.521308+0000","last_undegraded":"2024-04-15T23:38:10.521308+0000","last_fullsized":"2024-04-15T23:38:10.521308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'226","last_scrub_stamp":"2024-04-15T23:38:10.521192+0000","last_deep_scrub":"79'226","last_deep_scrub_stamp":"2024-04-15T23:38:10.521192+0000","last_clean_scrub_stamp":"2024-04-15T23:38:10.521192+0000","objects_scrubbed":56,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:16:05.818704+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"79'211","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.815788+0000","last_change":"2024-04-15T23:38:24.815832+0000","last_active":"2024-04-15T23:38:24.815788+0000","last_peered":"2024-04-15T23:38:24.815788+0000","last_clean":"2024-04-15T23:38:24.815788+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:24.815788+0000","last_undegraded":"2024-04-15T23:38:24.815788+0000","last_fullsized":"2024-04-15T23:38:24.815788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:24.815711+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:24.815711+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.815711+0000","objects_scrubbed":49,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:17.481087+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"79'218","reported_seq":593,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:31.703061+0000","last_change":"2024-04-15T23:38:31.703094+0000","last_active":"2024-04-15T23:38:31.703061+0000","last_peered":"2024-04-15T23:38:31.703061+0000","last_clean":"2024-04-15T23:38:31.703061+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:31.703061+0000","last_undegraded":"2024-04-15T23:38:31.703061+0000","last_fullsized":"2024-04-15T23:38:31.703061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'218","last_scrub_stamp":"2024-04-15T23:38:31.702974+0000","last_deep_scrub":"79'218","last_deep_scrub_stamp":"2024-04-15T23:38:31.702974+0000","last_clean_scrub_stamp":"2024-04-15T23:38:31.702974+0000","objects_scrubbed":53,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:16:54.148300+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"79'215","reported_seq":376,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.531291+0000","last_change":"2024-04-15T23:38:14.531324+0000","last_active":"2024-04-15T23:38:14.531291+0000","last_peered":"2024-04-15T23:38:14.531291+0000","last_clean":"2024-04-15T23:38:14.531291+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:14.531291+0000","last_undegraded":"2024-04-15T23:38:14.531291+0000","last_fullsized":"2024-04-15T23:38:14.531291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:14.531213+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:14.531213+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.531213+0000","objects_scrubbed":59,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:23.389467+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"79'249","reported_seq":375,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:38.880970+0000","last_change":"2024-04-15T23:38:38.881045+0000","last_active":"2024-04-15T23:38:38.880970+0000","last_peered":"2024-04-15T23:38:38.880970+0000","last_clean":"2024-04-15T23:38:38.880970+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:38.880970+0000","last_undegraded":"2024-04-15T23:38:38.880970+0000","last_fullsized":"2024-04-15T23:38:38.880970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'249","last_scrub_stamp":"2024-04-15T23:38:38.880879+0000","last_deep_scrub":"79'249","last_deep_scrub_stamp":"2024-04-15T23:38:38.880879+0000","last_clean_scrub_stamp":"2024-04-15T23:38:38.880879+0000","objects_scrubbed":59,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:23:10.587111+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"79'206","reported_seq":323,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:47.173908+0000","last_change":"2024-04-15T23:38:47.173999+0000","last_active":"2024-04-15T23:38:47.173908+0000","last_peered":"2024-04-15T23:38:47.173908+0000","last_clean":"2024-04-15T23:38:47.173908+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:47.173908+0000","last_undegraded":"2024-04-15T23:38:47.173908+0000","last_fullsized":"2024-04-15T23:38:47.173908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'206","last_scrub_stamp":"2024-04-15T23:38:47.173805+0000","last_deep_scrub":"79'206","last_deep_scrub_stamp":"2024-04-15T23:38:47.173805+0000","last_clean_scrub_stamp":"2024-04-15T23:38:47.173805+0000","objects_scrubbed":46,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:58:15.691815+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"79'193","reported_seq":353,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:37.733627+0000","last_change":"2024-04-15T23:38:37.733667+0000","last_active":"2024-04-15T23:38:37.733627+0000","last_peered":"2024-04-15T23:38:37.733627+0000","last_clean":"2024-04-15T23:38:37.733627+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:37.733627+0000","last_undegraded":"2024-04-15T23:38:37.733627+0000","last_fullsized":"2024-04-15T23:38:37.733627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'193","last_scrub_stamp":"2024-04-15T23:38:37.733547+0000","last_deep_scrub":"79'193","last_deep_scrub_stamp":"2024-04-15T23:38:37.733547+0000","last_clean_scrub_stamp":"2024-04-15T23:38:37.733547+0000","objects_scrubbed":42,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:25:23.070600+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"79'222","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.934383+0000","last_change":"2024-04-15T23:38:12.934414+0000","last_active":"2024-04-15T23:38:12.934383+0000","last_peered":"2024-04-15T23:38:12.934383+0000","last_clean":"2024-04-15T23:38:12.934383+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:12.934383+0000","last_undegraded":"2024-04-15T23:38:12.934383+0000","last_fullsized":"2024-04-15T23:38:12.934383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'222","last_scrub_stamp":"2024-04-15T23:38:12.934301+0000","last_deep_scrub":"79'222","last_deep_scrub_stamp":"2024-04-15T23:38:12.934301+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.934301+0000","objects_scrubbed":55,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:53:01.608980+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"79'255","reported_seq":416,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:40.779529+0000","last_change":"2024-04-15T23:38:40.779572+0000","last_active":"2024-04-15T23:38:40.779529+0000","last_peered":"2024-04-15T23:38:40.779529+0000","last_clean":"2024-04-15T23:38:40.779529+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:40.779529+0000","last_undegraded":"2024-04-15T23:38:40.779529+0000","last_fullsized":"2024-04-15T23:38:40.779529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'255","last_scrub_stamp":"2024-04-15T23:38:40.779453+0000","last_deep_scrub":"79'255","last_deep_scrub_stamp":"2024-04-15T23:38:40.779453+0000","last_clean_scrub_stamp":"2024-04-15T23:38:40.779453+0000","objects_scrubbed":62,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:23:33.151712+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"79'252","reported_seq":383,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.824572+0000","last_change":"2024-04-15T23:38:27.824615+0000","last_active":"2024-04-15T23:38:27.824572+0000","last_peered":"2024-04-15T23:38:27.824572+0000","last_clean":"2024-04-15T23:38:27.824572+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:27.824572+0000","last_undegraded":"2024-04-15T23:38:27.824572+0000","last_fullsized":"2024-04-15T23:38:27.824572+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'252","last_scrub_stamp":"2024-04-15T23:38:27.824497+0000","last_deep_scrub":"79'252","last_deep_scrub_stamp":"2024-04-15T23:38:27.824497+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.824497+0000","objects_scrubbed":66,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:31:34.380602+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"79'242","reported_seq":629,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.188900+0000","last_change":"2024-04-15T23:38:13.188939+0000","last_active":"2024-04-15T23:38:13.188900+0000","last_peered":"2024-04-15T23:38:13.188900+0000","last_clean":"2024-04-15T23:38:13.188900+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:13.188900+0000","last_undegraded":"2024-04-15T23:38:13.188900+0000","last_fullsized":"2024-04-15T23:38:13.188900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'242","last_scrub_stamp":"2024-04-15T23:38:13.188813+0000","last_deep_scrub":"79'242","last_deep_scrub_stamp":"2024-04-15T23:38:13.188813+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.188813+0000","objects_scrubbed":61,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:32:30.280122+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"79'199","reported_seq":549,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.598089+0000","last_change":"2024-04-15T23:38:23.598089+0000","last_active":"2024-04-15T23:38:23.598089+0000","last_peered":"2024-04-15T23:38:23.598089+0000","last_clean":"2024-04-15T23:38:23.598089+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:23.598089+0000","last_undegraded":"2024-04-15T23:38:23.598089+0000","last_fullsized":"2024-04-15T23:38:23.598089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'199","last_scrub_stamp":"2024-04-15T23:38:23.597922+0000","last_deep_scrub":"79'199","last_deep_scrub_stamp":"2024-04-15T23:38:23.597922+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.597922+0000","objects_scrubbed":46,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:51:09.121996+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"79'134","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.199524+0000","last_change":"2024-04-15T23:38:28.199567+0000","last_active":"2024-04-15T23:38:28.199524+0000","last_peered":"2024-04-15T23:38:28.199524+0000","last_clean":"2024-04-15T23:38:28.199524+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:28.199524+0000","last_undegraded":"2024-04-15T23:38:28.199524+0000","last_fullsized":"2024-04-15T23:38:28.199524+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'134","last_scrub_stamp":"2024-04-15T23:38:28.199397+0000","last_deep_scrub":"79'134","last_deep_scrub_stamp":"2024-04-15T23:38:28.199397+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.199397+0000","objects_scrubbed":3,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:08:31.341770+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"79'193","reported_seq":543,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:34.736158+0000","last_change":"2024-04-15T23:38:34.736158+0000","last_active":"2024-04-15T23:38:34.736158+0000","last_peered":"2024-04-15T23:38:34.736158+0000","last_clean":"2024-04-15T23:38:34.736158+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:34.736158+0000","last_undegraded":"2024-04-15T23:38:34.736158+0000","last_fullsized":"2024-04-15T23:38:34.736158+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'193","last_scrub_stamp":"2024-04-15T23:38:34.735976+0000","last_deep_scrub":"79'193","last_deep_scrub_stamp":"2024-04-15T23:38:34.735976+0000","last_clean_scrub_stamp":"2024-04-15T23:38:34.735976+0000","objects_scrubbed":41,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:55:44.942188+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:40.861122+0000","last_change":"2024-04-15T23:38:40.861149+0000","last_active":"2024-04-15T23:38:40.861122+0000","last_peered":"2024-04-15T23:38:40.861122+0000","last_clean":"2024-04-15T23:38:40.861122+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:40.861122+0000","last_undegraded":"2024-04-15T23:38:40.861122+0000","last_fullsized":"2024-04-15T23:38:40.861122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:40.861005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:40.861005+0000","last_clean_scrub_stamp":"2024-04-15T23:38:40.861005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:34:40.015234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"79'243","reported_seq":371,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.887241+0000","last_change":"2024-04-15T23:38:22.887269+0000","last_active":"2024-04-15T23:38:22.887241+0000","last_peered":"2024-04-15T23:38:22.887241+0000","last_clean":"2024-04-15T23:38:22.887241+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:22.887241+0000","last_undegraded":"2024-04-15T23:38:22.887241+0000","last_fullsized":"2024-04-15T23:38:22.887241+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'243","last_scrub_stamp":"2024-04-15T23:38:22.887161+0000","last_deep_scrub":"79'243","last_deep_scrub_stamp":"2024-04-15T23:38:22.887161+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.887161+0000","objects_scrubbed":51,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:43:24.550219+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.553977+0000","last_change":"2024-04-15T23:38:16.553977+0000","last_active":"2024-04-15T23:38:16.553977+0000","last_peered":"2024-04-15T23:38:16.553977+0000","last_clean":"2024-04-15T23:38:16.553977+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:16.553977+0000","last_undegraded":"2024-04-15T23:38:16.553977+0000","last_fullsized":"2024-04-15T23:38:16.553977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:16.553862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:16.553862+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.553862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:08:22.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"79'217","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:39.871794+0000","last_change":"2024-04-15T23:38:39.871831+0000","last_active":"2024-04-15T23:38:39.871794+0000","last_peered":"2024-04-15T23:38:39.871794+0000","last_clean":"2024-04-15T23:38:39.871794+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:39.871794+0000","last_undegraded":"2024-04-15T23:38:39.871794+0000","last_fullsized":"2024-04-15T23:38:39.871794+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'217","last_scrub_stamp":"2024-04-15T23:38:39.871699+0000","last_deep_scrub":"79'217","last_deep_scrub_stamp":"2024-04-15T23:38:39.871699+0000","last_clean_scrub_stamp":"2024-04-15T23:38:39.871699+0000","objects_scrubbed":39,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:30:32.919486+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"79'13","reported_seq":122,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.182671+0000","last_change":"2024-04-15T23:38:12.182714+0000","last_active":"2024-04-15T23:38:12.182671+0000","last_peered":"2024-04-15T23:38:12.182671+0000","last_clean":"2024-04-15T23:38:12.182671+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:12.182671+0000","last_undegraded":"2024-04-15T23:38:12.182671+0000","last_fullsized":"2024-04-15T23:38:12.182671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'13","last_scrub_stamp":"2024-04-15T23:38:12.182588+0000","last_deep_scrub":"79'13","last_deep_scrub_stamp":"2024-04-15T23:38:12.182588+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.182588+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:40:29.437300+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:31.234015+0000","last_change":"2024-04-15T23:38:31.234057+0000","last_active":"2024-04-15T23:38:31.234015+0000","last_peered":"2024-04-15T23:38:31.234015+0000","last_clean":"2024-04-15T23:38:31.234015+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:31.234015+0000","last_undegraded":"2024-04-15T23:38:31.234015+0000","last_fullsized":"2024-04-15T23:38:31.234015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-15T23:38:31.233892+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-15T23:38:31.233892+0000","last_clean_scrub_stamp":"2024-04-15T23:38:31.233892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:53.883142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"79'209","reported_seq":370,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.568416+0000","last_change":"2024-04-15T23:38:12.568452+0000","last_active":"2024-04-15T23:38:12.568416+0000","last_peered":"2024-04-15T23:38:12.568416+0000","last_clean":"2024-04-15T23:38:12.568416+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:12.568416+0000","last_undegraded":"2024-04-15T23:38:12.568416+0000","last_fullsized":"2024-04-15T23:38:12.568416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'209","last_scrub_stamp":"2024-04-15T23:38:12.568335+0000","last_deep_scrub":"79'209","last_deep_scrub_stamp":"2024-04-15T23:38:12.568335+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.568335+0000","objects_scrubbed":56,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:16.914156+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"79'4","reported_seq":165,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:36.673768+0000","last_change":"2024-04-15T23:38:36.673801+0000","last_active":"2024-04-15T23:38:36.673768+0000","last_peered":"2024-04-15T23:38:36.673768+0000","last_clean":"2024-04-15T23:38:36.673768+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:36.673768+0000","last_undegraded":"2024-04-15T23:38:36.673768+0000","last_fullsized":"2024-04-15T23:38:36.673768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-15T23:38:36.673679+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-15T23:38:36.673679+0000","last_clean_scrub_stamp":"2024-04-15T23:38:36.673679+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:11:34.471554+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"79'231","reported_seq":631,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:33.697587+0000","last_change":"2024-04-15T23:38:33.697621+0000","last_active":"2024-04-15T23:38:33.697587+0000","last_peered":"2024-04-15T23:38:33.697587+0000","last_clean":"2024-04-15T23:38:33.697587+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:33.697587+0000","last_undegraded":"2024-04-15T23:38:33.697587+0000","last_fullsized":"2024-04-15T23:38:33.697587+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'231","last_scrub_stamp":"2024-04-15T23:38:33.697505+0000","last_deep_scrub":"79'231","last_deep_scrub_stamp":"2024-04-15T23:38:33.697505+0000","last_clean_scrub_stamp":"2024-04-15T23:38:33.697505+0000","objects_scrubbed":54,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:04:12.540641+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:44.104115+0000","last_change":"2024-04-15T23:38:44.104160+0000","last_active":"2024-04-15T23:38:44.104115+0000","last_peered":"2024-04-15T23:38:44.104115+0000","last_clean":"2024-04-15T23:38:44.104115+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:44.104115+0000","last_undegraded":"2024-04-15T23:38:44.104115+0000","last_fullsized":"2024-04-15T23:38:44.104115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-15T23:38:44.104008+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-15T23:38:44.104008+0000","last_clean_scrub_stamp":"2024-04-15T23:38:44.104008+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:44:09.098063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"79'202","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.220318+0000","last_change":"2024-04-15T23:38:19.220351+0000","last_active":"2024-04-15T23:38:19.220318+0000","last_peered":"2024-04-15T23:38:19.220318+0000","last_clean":"2024-04-15T23:38:19.220318+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:19.220318+0000","last_undegraded":"2024-04-15T23:38:19.220318+0000","last_fullsized":"2024-04-15T23:38:19.220318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:19.220237+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:19.220237+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.220237+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:58:12.248305+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.190109+0000","last_change":"2024-04-15T23:38:22.190134+0000","last_active":"2024-04-15T23:38:22.190109+0000","last_peered":"2024-04-15T23:38:22.190109+0000","last_clean":"2024-04-15T23:38:22.190109+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:22.190109+0000","last_undegraded":"2024-04-15T23:38:22.190109+0000","last_fullsized":"2024-04-15T23:38:22.190109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'1","last_scrub_stamp":"2024-04-15T23:38:22.190022+0000","last_deep_scrub":"50'1","last_deep_scrub_stamp":"2024-04-15T23:38:22.190022+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.190022+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:51.403732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"79'216","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:43.868215+0000","last_change":"2024-04-15T23:38:43.868250+0000","last_active":"2024-04-15T23:38:43.868215+0000","last_peered":"2024-04-15T23:38:43.868215+0000","last_clean":"2024-04-15T23:38:43.868215+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:43.868215+0000","last_undegraded":"2024-04-15T23:38:43.868215+0000","last_fullsized":"2024-04-15T23:38:43.868215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:43.868138+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:43.868138+0000","last_clean_scrub_stamp":"2024-04-15T23:38:43.868138+0000","objects_scrubbed":60,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:21:29.518202+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'9","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:36.904358+0000","last_change":"2024-04-15T23:38:36.904398+0000","last_active":"2024-04-15T23:38:36.904358+0000","last_peered":"2024-04-15T23:38:36.904358+0000","last_clean":"2024-04-15T23:38:36.904358+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:36.904358+0000","last_undegraded":"2024-04-15T23:38:36.904358+0000","last_fullsized":"2024-04-15T23:38:36.904358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-04-15T23:38:36.904275+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-04-15T23:38:36.904275+0000","last_clean_scrub_stamp":"2024-04-15T23:38:36.904275+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:44:00.249030+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"79'238","reported_seq":631,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.193816+0000","last_change":"2024-04-15T23:38:17.193855+0000","last_active":"2024-04-15T23:38:17.193816+0000","last_peered":"2024-04-15T23:38:17.193816+0000","last_clean":"2024-04-15T23:38:17.193816+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:17.193816+0000","last_undegraded":"2024-04-15T23:38:17.193816+0000","last_fullsized":"2024-04-15T23:38:17.193816+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'238","last_scrub_stamp":"2024-04-15T23:38:17.193722+0000","last_deep_scrub":"79'238","last_deep_scrub_stamp":"2024-04-15T23:38:17.193722+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.193722+0000","objects_scrubbed":58,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:26.910291+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.209663+0000","last_change":"2024-04-15T23:38:24.209687+0000","last_active":"2024-04-15T23:38:24.209663+0000","last_peered":"2024-04-15T23:38:24.209663+0000","last_clean":"2024-04-15T23:38:24.209663+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:24.209663+0000","last_undegraded":"2024-04-15T23:38:24.209663+0000","last_fullsized":"2024-04-15T23:38:24.209663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:24.209573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:24.209573+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.209573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:57:42.293988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"79'224","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:45.157071+0000","last_change":"2024-04-15T23:38:45.157103+0000","last_active":"2024-04-15T23:38:45.157071+0000","last_peered":"2024-04-15T23:38:45.157071+0000","last_clean":"2024-04-15T23:38:45.157071+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:45.157071+0000","last_undegraded":"2024-04-15T23:38:45.157071+0000","last_fullsized":"2024-04-15T23:38:45.157071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'224","last_scrub_stamp":"2024-04-15T23:38:45.156993+0000","last_deep_scrub":"79'224","last_deep_scrub_stamp":"2024-04-15T23:38:45.156993+0000","last_clean_scrub_stamp":"2024-04-15T23:38:45.156993+0000","objects_scrubbed":58,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:48:07.359784+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.487326+0000","last_change":"2024-04-15T23:38:11.487368+0000","last_active":"2024-04-15T23:38:11.487326+0000","last_peered":"2024-04-15T23:38:11.487326+0000","last_clean":"2024-04-15T23:38:11.487326+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:11.487326+0000","last_undegraded":"2024-04-15T23:38:11.487326+0000","last_fullsized":"2024-04-15T23:38:11.487326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:11.487224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:11.487224+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.487224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:54:24.474774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"79'191","reported_seq":312,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.213138+0000","last_change":"2024-04-15T23:38:14.213167+0000","last_active":"2024-04-15T23:38:14.213138+0000","last_peered":"2024-04-15T23:38:14.213138+0000","last_clean":"2024-04-15T23:38:14.213138+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:14.213138+0000","last_undegraded":"2024-04-15T23:38:14.213138+0000","last_fullsized":"2024-04-15T23:38:14.213138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'191","last_scrub_stamp":"2024-04-15T23:38:14.213023+0000","last_deep_scrub":"79'191","last_deep_scrub_stamp":"2024-04-15T23:38:14.213023+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.213023+0000","objects_scrubbed":53,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:01:47.573046+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":162,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:29.662894+0000","last_change":"2024-04-15T23:38:29.662927+0000","last_active":"2024-04-15T23:38:29.662894+0000","last_peered":"2024-04-15T23:38:29.662894+0000","last_clean":"2024-04-15T23:38:29.662894+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:29.662894+0000","last_undegraded":"2024-04-15T23:38:29.662894+0000","last_fullsized":"2024-04-15T23:38:29.662894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-15T23:38:29.662807+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-15T23:38:29.662807+0000","last_clean_scrub_stamp":"2024-04-15T23:38:29.662807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:07.870480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"79'192","reported_seq":316,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.956276+0000","last_change":"2024-04-15T23:38:17.956327+0000","last_active":"2024-04-15T23:38:17.956276+0000","last_peered":"2024-04-15T23:38:17.956276+0000","last_clean":"2024-04-15T23:38:17.956276+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:17.956276+0000","last_undegraded":"2024-04-15T23:38:17.956276+0000","last_fullsized":"2024-04-15T23:38:17.956276+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'192","last_scrub_stamp":"2024-04-15T23:38:17.956191+0000","last_deep_scrub":"79'192","last_deep_scrub_stamp":"2024-04-15T23:38:17.956191+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.956191+0000","objects_scrubbed":47,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:08:43.386809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":324,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.150976+0000","last_change":"2024-04-15T23:38:15.151005+0000","last_active":"2024-04-15T23:38:15.150976+0000","last_peered":"2024-04-15T23:38:15.150976+0000","last_clean":"2024-04-15T23:38:15.150976+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:15.150976+0000","last_undegraded":"2024-04-15T23:38:15.150976+0000","last_fullsized":"2024-04-15T23:38:15.150976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-15T23:38:15.150888+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-15T23:38:15.150888+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.150888+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:50:53.833085+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.162983+0000","last_change":"2024-04-15T23:38:21.163009+0000","last_active":"2024-04-15T23:38:21.162983+0000","last_peered":"2024-04-15T23:38:21.162983+0000","last_clean":"2024-04-15T23:38:21.162983+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:21.162983+0000","last_undegraded":"2024-04-15T23:38:21.162983+0000","last_fullsized":"2024-04-15T23:38:21.162983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:21.162886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:21.162886+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.162886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:32:05.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:33.904806+0000","last_change":"2024-04-15T23:38:33.904873+0000","last_active":"2024-04-15T23:38:33.904806+0000","last_peered":"2024-04-15T23:38:33.904806+0000","last_clean":"2024-04-15T23:38:33.904806+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:33.904806+0000","last_undegraded":"2024-04-15T23:38:33.904806+0000","last_fullsized":"2024-04-15T23:38:33.904806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'1","last_scrub_stamp":"2024-04-15T23:38:33.904691+0000","last_deep_scrub":"46'1","last_deep_scrub_stamp":"2024-04-15T23:38:33.904691+0000","last_clean_scrub_stamp":"2024-04-15T23:38:33.904691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:24:36.293883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"79'207","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:46.178599+0000","last_change":"2024-04-15T23:38:46.178629+0000","last_active":"2024-04-15T23:38:46.178599+0000","last_peered":"2024-04-15T23:38:46.178599+0000","last_clean":"2024-04-15T23:38:46.178599+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:46.178599+0000","last_undegraded":"2024-04-15T23:38:46.178599+0000","last_fullsized":"2024-04-15T23:38:46.178599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'207","last_scrub_stamp":"2024-04-15T23:38:46.178523+0000","last_deep_scrub":"79'207","last_deep_scrub_stamp":"2024-04-15T23:38:46.178523+0000","last_clean_scrub_stamp":"2024-04-15T23:38:46.178523+0000","objects_scrubbed":56,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:53.748926+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.201845+0000","last_change":"2024-04-15T23:38:11.201867+0000","last_active":"2024-04-15T23:38:11.201845+0000","last_peered":"2024-04-15T23:38:11.201845+0000","last_clean":"2024-04-15T23:38:11.201845+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:11.201845+0000","last_undegraded":"2024-04-15T23:38:11.201845+0000","last_fullsized":"2024-04-15T23:38:11.201845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:11.201750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:11.201750+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.201750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:38:43.306147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'36","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.930002+0000","last_change":"2024-04-15T23:38:18.930031+0000","last_active":"2024-04-15T23:38:18.930002+0000","last_peered":"2024-04-15T23:38:18.930002+0000","last_clean":"2024-04-15T23:38:18.930002+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:18.930002+0000","last_undegraded":"2024-04-15T23:38:18.930002+0000","last_fullsized":"2024-04-15T23:38:18.930002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'36","last_scrub_stamp":"2024-04-15T23:38:18.929917+0000","last_deep_scrub":"79'36","last_deep_scrub_stamp":"2024-04-15T23:38:18.929917+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.929917+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:48:20.198030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"79'216","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.599326+0000","last_change":"2024-04-15T23:38:19.599364+0000","last_active":"2024-04-15T23:38:19.599326+0000","last_peered":"2024-04-15T23:38:19.599326+0000","last_clean":"2024-04-15T23:38:19.599326+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:19.599326+0000","last_undegraded":"2024-04-15T23:38:19.599326+0000","last_fullsized":"2024-04-15T23:38:19.599326+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:19.599234+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:19.599234+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.599234+0000","objects_scrubbed":57,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:56:14.976800+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:30.820966+0000","last_change":"2024-04-15T23:38:30.821014+0000","last_active":"2024-04-15T23:38:30.820966+0000","last_peered":"2024-04-15T23:38:30.820966+0000","last_clean":"2024-04-15T23:38:30.820966+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:30.820966+0000","last_undegraded":"2024-04-15T23:38:30.820966+0000","last_fullsized":"2024-04-15T23:38:30.820966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:30.820871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:30.820871+0000","last_clean_scrub_stamp":"2024-04-15T23:38:30.820871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:15:14.806089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'57","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.546341+0000","last_change":"2024-04-15T23:38:22.546399+0000","last_active":"2024-04-15T23:38:22.546341+0000","last_peered":"2024-04-15T23:38:22.546341+0000","last_clean":"2024-04-15T23:38:22.546341+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:22.546341+0000","last_undegraded":"2024-04-15T23:38:22.546341+0000","last_fullsized":"2024-04-15T23:38:22.546341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'57","last_scrub_stamp":"2024-04-15T23:38:22.546216+0000","last_deep_scrub":"79'57","last_deep_scrub_stamp":"2024-04-15T23:38:22.546216+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.546216+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:55:52.662990+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"79'221","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.873315+0000","last_change":"2024-04-15T23:38:21.873345+0000","last_active":"2024-04-15T23:38:21.873315+0000","last_peered":"2024-04-15T23:38:21.873315+0000","last_clean":"2024-04-15T23:38:21.873315+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:21.873315+0000","last_undegraded":"2024-04-15T23:38:21.873315+0000","last_fullsized":"2024-04-15T23:38:21.873315+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'221","last_scrub_stamp":"2024-04-15T23:38:21.873225+0000","last_deep_scrub":"79'221","last_deep_scrub_stamp":"2024-04-15T23:38:21.873225+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.873225+0000","objects_scrubbed":57,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:07:35.908985+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.169337+0000","last_change":"2024-04-15T23:38:20.169363+0000","last_active":"2024-04-15T23:38:20.169337+0000","last_peered":"2024-04-15T23:38:20.169337+0000","last_clean":"2024-04-15T23:38:20.169337+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:20.169337+0000","last_undegraded":"2024-04-15T23:38:20.169337+0000","last_fullsized":"2024-04-15T23:38:20.169337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:20.169233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:20.169233+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.169233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:18:09.381116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.211257+0000","last_change":"2024-04-15T23:38:23.211296+0000","last_active":"2024-04-15T23:38:23.211257+0000","last_peered":"2024-04-15T23:38:23.211257+0000","last_clean":"2024-04-15T23:38:23.211257+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:23.211257+0000","last_undegraded":"2024-04-15T23:38:23.211257+0000","last_fullsized":"2024-04-15T23:38:23.211257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:23.211170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:23.211170+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.211170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:30.223970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"79'211","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.907948+0000","last_change":"2024-04-15T23:38:13.907976+0000","last_active":"2024-04-15T23:38:13.907948+0000","last_peered":"2024-04-15T23:38:13.907948+0000","last_clean":"2024-04-15T23:38:13.907948+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:13.907948+0000","last_undegraded":"2024-04-15T23:38:13.907948+0000","last_fullsized":"2024-04-15T23:38:13.907948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:13.907868+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:13.907868+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.907868+0000","objects_scrubbed":54,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:04:37.554420+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:39.135139+0000","last_change":"2024-04-15T23:38:39.135163+0000","last_active":"2024-04-15T23:38:39.135139+0000","last_peered":"2024-04-15T23:38:39.135139+0000","last_clean":"2024-04-15T23:38:39.135139+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:39.135139+0000","last_undegraded":"2024-04-15T23:38:39.135139+0000","last_fullsized":"2024-04-15T23:38:39.135139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:39.135017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:39.135017+0000","last_clean_scrub_stamp":"2024-04-15T23:38:39.135017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:08:04.771550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:29.783610+0000","last_change":"2024-04-15T23:38:29.783645+0000","last_active":"2024-04-15T23:38:29.783610+0000","last_peered":"2024-04-15T23:38:29.783610+0000","last_clean":"2024-04-15T23:38:29.783610+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:29.783610+0000","last_undegraded":"2024-04-15T23:38:29.783610+0000","last_fullsized":"2024-04-15T23:38:29.783610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:29.783477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:29.783477+0000","last_clean_scrub_stamp":"2024-04-15T23:38:29.783477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:27:38.280758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"79'257","reported_seq":417,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:39.725481+0000","last_change":"2024-04-15T23:38:39.725535+0000","last_active":"2024-04-15T23:38:39.725481+0000","last_peered":"2024-04-15T23:38:39.725481+0000","last_clean":"2024-04-15T23:38:39.725481+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:39.725481+0000","last_undegraded":"2024-04-15T23:38:39.725481+0000","last_fullsized":"2024-04-15T23:38:39.725481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'257","last_scrub_stamp":"2024-04-15T23:38:39.725403+0000","last_deep_scrub":"79'257","last_deep_scrub_stamp":"2024-04-15T23:38:39.725403+0000","last_clean_scrub_stamp":"2024-04-15T23:38:39.725403+0000","objects_scrubbed":46,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:10:58.026569+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:31.863123+0000","last_change":"2024-04-15T23:38:31.863146+0000","last_active":"2024-04-15T23:38:31.863123+0000","last_peered":"2024-04-15T23:38:31.863123+0000","last_clean":"2024-04-15T23:38:31.863123+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:31.863123+0000","last_undegraded":"2024-04-15T23:38:31.863123+0000","last_fullsized":"2024-04-15T23:38:31.863123+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'1","last_scrub_stamp":"2024-04-15T23:38:31.863024+0000","last_deep_scrub":"46'1","last_deep_scrub_stamp":"2024-04-15T23:38:31.863024+0000","last_clean_scrub_stamp":"2024-04-15T23:38:31.863024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:05:10.267833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.614971+0000","last_change":"2024-04-15T23:38:28.615047+0000","last_active":"2024-04-15T23:38:28.614971+0000","last_peered":"2024-04-15T23:38:28.614971+0000","last_clean":"2024-04-15T23:38:28.614971+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:28.614971+0000","last_undegraded":"2024-04-15T23:38:28.614971+0000","last_fullsized":"2024-04-15T23:38:28.614971+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:28.614855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:28.614855+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.614855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:04:30.732928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"79'233","reported_seq":394,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.607055+0000","last_change":"2024-04-15T23:38:26.607087+0000","last_active":"2024-04-15T23:38:26.607055+0000","last_peered":"2024-04-15T23:38:26.607055+0000","last_clean":"2024-04-15T23:38:26.607055+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:26.607055+0000","last_undegraded":"2024-04-15T23:38:26.607055+0000","last_fullsized":"2024-04-15T23:38:26.607055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'233","last_scrub_stamp":"2024-04-15T23:38:26.606966+0000","last_deep_scrub":"79'233","last_deep_scrub_stamp":"2024-04-15T23:38:26.606966+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.606966+0000","objects_scrubbed":53,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:39.151099+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:34.934974+0000","last_change":"2024-04-15T23:38:34.935013+0000","last_active":"2024-04-15T23:38:34.934974+0000","last_peered":"2024-04-15T23:38:34.934974+0000","last_clean":"2024-04-15T23:38:34.934974+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:34.934974+0000","last_undegraded":"2024-04-15T23:38:34.934974+0000","last_fullsized":"2024-04-15T23:38:34.934974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:34.934893+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:34.934893+0000","last_clean_scrub_stamp":"2024-04-15T23:38:34.934893+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:41:51.330998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:32.898694+0000","last_change":"2024-04-15T23:38:32.898719+0000","last_active":"2024-04-15T23:38:32.898694+0000","last_peered":"2024-04-15T23:38:32.898694+0000","last_clean":"2024-04-15T23:38:32.898694+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:32.898694+0000","last_undegraded":"2024-04-15T23:38:32.898694+0000","last_fullsized":"2024-04-15T23:38:32.898694+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:32.898600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:32.898600+0000","last_clean_scrub_stamp":"2024-04-15T23:38:32.898600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:21.574949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"79'215","reported_seq":347,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:42.846105+0000","last_change":"2024-04-15T23:38:42.846155+0000","last_active":"2024-04-15T23:38:42.846105+0000","last_peered":"2024-04-15T23:38:42.846105+0000","last_clean":"2024-04-15T23:38:42.846105+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:42.846105+0000","last_undegraded":"2024-04-15T23:38:42.846105+0000","last_fullsized":"2024-04-15T23:38:42.846105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:42.846025+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:42.846025+0000","last_clean_scrub_stamp":"2024-04-15T23:38:42.846025+0000","objects_scrubbed":60,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:04:29.397205+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'37","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.920225+0000","last_change":"2024-04-15T23:38:16.920251+0000","last_active":"2024-04-15T23:38:16.920225+0000","last_peered":"2024-04-15T23:38:16.920225+0000","last_clean":"2024-04-15T23:38:16.920225+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:16.920225+0000","last_undegraded":"2024-04-15T23:38:16.920225+0000","last_fullsized":"2024-04-15T23:38:16.920225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'37","last_scrub_stamp":"2024-04-15T23:38:16.920141+0000","last_deep_scrub":"79'37","last_deep_scrub_stamp":"2024-04-15T23:38:16.920141+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.920141+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:05:28.389525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.224776+0000","last_change":"2024-04-15T23:38:27.224802+0000","last_active":"2024-04-15T23:38:27.224776+0000","last_peered":"2024-04-15T23:38:27.224776+0000","last_clean":"2024-04-15T23:38:27.224776+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:27.224776+0000","last_undegraded":"2024-04-15T23:38:27.224776+0000","last_fullsized":"2024-04-15T23:38:27.224776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:27.224626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:27.224626+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.224626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:02.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"79'191","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.584056+0000","last_change":"2024-04-15T23:38:24.584113+0000","last_active":"2024-04-15T23:38:24.584056+0000","last_peered":"2024-04-15T23:38:24.584056+0000","last_clean":"2024-04-15T23:38:24.584056+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:24.584056+0000","last_undegraded":"2024-04-15T23:38:24.584056+0000","last_fullsized":"2024-04-15T23:38:24.584056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'191","last_scrub_stamp":"2024-04-15T23:38:24.583969+0000","last_deep_scrub":"79'191","last_deep_scrub_stamp":"2024-04-15T23:38:24.583969+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.583969+0000","objects_scrubbed":49,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:30:23.632335+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"79'221","reported_seq":338,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:42.169368+0000","last_change":"2024-04-15T23:38:42.169430+0000","last_active":"2024-04-15T23:38:42.169368+0000","last_peered":"2024-04-15T23:38:42.169368+0000","last_clean":"2024-04-15T23:38:42.169368+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:42.169368+0000","last_undegraded":"2024-04-15T23:38:42.169368+0000","last_fullsized":"2024-04-15T23:38:42.169368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'221","last_scrub_stamp":"2024-04-15T23:38:42.169283+0000","last_deep_scrub":"79'221","last_deep_scrub_stamp":"2024-04-15T23:38:42.169283+0000","last_clean_scrub_stamp":"2024-04-15T23:38:42.169283+0000","objects_scrubbed":66,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:31.569696+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'47","reported_seq":176,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:29.161814+0000","last_change":"2024-04-15T23:38:29.161849+0000","last_active":"2024-04-15T23:38:29.161814+0000","last_peered":"2024-04-15T23:38:29.161814+0000","last_clean":"2024-04-15T23:38:29.161814+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:29.161814+0000","last_undegraded":"2024-04-15T23:38:29.161814+0000","last_fullsized":"2024-04-15T23:38:29.161814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'47","last_scrub_stamp":"2024-04-15T23:38:29.161727+0000","last_deep_scrub":"79'47","last_deep_scrub_stamp":"2024-04-15T23:38:29.161727+0000","last_clean_scrub_stamp":"2024-04-15T23:38:29.161727+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:52:36.405857+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"79'202","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.847512+0000","last_change":"2024-04-15T23:38:23.847575+0000","last_active":"2024-04-15T23:38:23.847512+0000","last_peered":"2024-04-15T23:38:23.847512+0000","last_clean":"2024-04-15T23:38:23.847512+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:23.847512+0000","last_undegraded":"2024-04-15T23:38:23.847512+0000","last_fullsized":"2024-04-15T23:38:23.847512+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:23.847415+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:23.847415+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.847415+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:00:40.815243+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"79'25","reported_seq":186,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:43.781927+0000","last_change":"2024-04-15T23:38:43.781927+0000","last_active":"2024-04-15T23:38:43.781927+0000","last_peered":"2024-04-15T23:38:43.781927+0000","last_clean":"2024-04-15T23:38:43.781927+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:43.781927+0000","last_undegraded":"2024-04-15T23:38:43.781927+0000","last_fullsized":"2024-04-15T23:38:43.781927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'25","last_scrub_stamp":"2024-04-15T23:38:43.781795+0000","last_deep_scrub":"79'25","last_deep_scrub_stamp":"2024-04-15T23:38:43.781795+0000","last_clean_scrub_stamp":"2024-04-15T23:38:43.781795+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:18:55.811032+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:33.229948+0000","last_change":"2024-04-15T23:38:33.229974+0000","last_active":"2024-04-15T23:38:33.229948+0000","last_peered":"2024-04-15T23:38:33.229948+0000","last_clean":"2024-04-15T23:38:33.229948+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:33.229948+0000","last_undegraded":"2024-04-15T23:38:33.229948+0000","last_fullsized":"2024-04-15T23:38:33.229948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:33.229860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:33.229860+0000","last_clean_scrub_stamp":"2024-04-15T23:38:33.229860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:27:43.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"79'236","reported_seq":374,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:41.895672+0000","last_change":"2024-04-15T23:38:41.895732+0000","last_active":"2024-04-15T23:38:41.895672+0000","last_peered":"2024-04-15T23:38:41.895672+0000","last_clean":"2024-04-15T23:38:41.895672+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:41.895672+0000","last_undegraded":"2024-04-15T23:38:41.895672+0000","last_fullsized":"2024-04-15T23:38:41.895672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'236","last_scrub_stamp":"2024-04-15T23:38:41.895550+0000","last_deep_scrub":"79'236","last_deep_scrub_stamp":"2024-04-15T23:38:41.895550+0000","last_clean_scrub_stamp":"2024-04-15T23:38:41.895550+0000","objects_scrubbed":64,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:21.468655+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.911580+0000","last_change":"2024-04-15T23:38:11.911623+0000","last_active":"2024-04-15T23:38:11.911580+0000","last_peered":"2024-04-15T23:38:11.911580+0000","last_clean":"2024-04-15T23:38:11.911580+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:11.911580+0000","last_undegraded":"2024-04-15T23:38:11.911580+0000","last_fullsized":"2024-04-15T23:38:11.911580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2024-04-15T23:38:11.911437+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2024-04-15T23:38:11.911437+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.911437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:07.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"79'209","reported_seq":340,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.805793+0000","last_change":"2024-04-15T23:38:25.805819+0000","last_active":"2024-04-15T23:38:25.805793+0000","last_peered":"2024-04-15T23:38:25.805793+0000","last_clean":"2024-04-15T23:38:25.805793+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:25.805793+0000","last_undegraded":"2024-04-15T23:38:25.805793+0000","last_fullsized":"2024-04-15T23:38:25.805793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'209","last_scrub_stamp":"2024-04-15T23:38:25.805715+0000","last_deep_scrub":"79'209","last_deep_scrub_stamp":"2024-04-15T23:38:25.805715+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.805715+0000","objects_scrubbed":50,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:04:19.023092+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"79'224","reported_seq":385,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:38.696656+0000","last_change":"2024-04-15T23:38:38.696683+0000","last_active":"2024-04-15T23:38:38.696656+0000","last_peered":"2024-04-15T23:38:38.696656+0000","last_clean":"2024-04-15T23:38:38.696656+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:38.696656+0000","last_undegraded":"2024-04-15T23:38:38.696656+0000","last_fullsized":"2024-04-15T23:38:38.696656+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'224","last_scrub_stamp":"2024-04-15T23:38:38.696579+0000","last_deep_scrub":"79'224","last_deep_scrub_stamp":"2024-04-15T23:38:38.696579+0000","last_clean_scrub_stamp":"2024-04-15T23:38:38.696579+0000","objects_scrubbed":53,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:37:33.027964+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.746736+0000","last_change":"2024-04-15T23:38:28.746758+0000","last_active":"2024-04-15T23:38:28.746736+0000","last_peered":"2024-04-15T23:38:28.746736+0000","last_clean":"2024-04-15T23:38:28.746736+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:28.746736+0000","last_undegraded":"2024-04-15T23:38:28.746736+0000","last_fullsized":"2024-04-15T23:38:28.746736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-15T23:38:28.746647+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-15T23:38:28.746647+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.746647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:25.774524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"79'204","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:37.906551+0000","last_change":"2024-04-15T23:38:37.906615+0000","last_active":"2024-04-15T23:38:37.906551+0000","last_peered":"2024-04-15T23:38:37.906551+0000","last_clean":"2024-04-15T23:38:37.906551+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:37.906551+0000","last_undegraded":"2024-04-15T23:38:37.906551+0000","last_fullsized":"2024-04-15T23:38:37.906551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'204","last_scrub_stamp":"2024-04-15T23:38:37.906406+0000","last_deep_scrub":"79'204","last_deep_scrub_stamp":"2024-04-15T23:38:37.906406+0000","last_clean_scrub_stamp":"2024-04-15T23:38:37.906406+0000","objects_scrubbed":47,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:28:14.525460+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.873570+0000","last_change":"2024-04-15T23:38:20.873620+0000","last_active":"2024-04-15T23:38:20.873570+0000","last_peered":"2024-04-15T23:38:20.873570+0000","last_clean":"2024-04-15T23:38:20.873570+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:20.873570+0000","last_undegraded":"2024-04-15T23:38:20.873570+0000","last_fullsized":"2024-04-15T23:38:20.873570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:20.873470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:20.873470+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.873470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:49:50.516057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"79'210","reported_seq":370,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:41.835375+0000","last_change":"2024-04-15T23:38:41.835412+0000","last_active":"2024-04-15T23:38:41.835375+0000","last_peered":"2024-04-15T23:38:41.835375+0000","last_clean":"2024-04-15T23:38:41.835375+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:41.835375+0000","last_undegraded":"2024-04-15T23:38:41.835375+0000","last_fullsized":"2024-04-15T23:38:41.835375+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:41.835294+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:41.835294+0000","last_clean_scrub_stamp":"2024-04-15T23:38:41.835294+0000","objects_scrubbed":62,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:12:39.398581+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"79'3","reported_seq":168,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:30.658179+0000","last_change":"2024-04-15T23:38:30.658212+0000","last_active":"2024-04-15T23:38:30.658179+0000","last_peered":"2024-04-15T23:38:30.658179+0000","last_clean":"2024-04-15T23:38:30.658179+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:30.658179+0000","last_undegraded":"2024-04-15T23:38:30.658179+0000","last_fullsized":"2024-04-15T23:38:30.658179+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:30.658093+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:30.658093+0000","last_clean_scrub_stamp":"2024-04-15T23:38:30.658093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:15.193263+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"79'220","reported_seq":592,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:35.721445+0000","last_change":"2024-04-15T23:38:35.721480+0000","last_active":"2024-04-15T23:38:35.721445+0000","last_peered":"2024-04-15T23:38:35.721445+0000","last_clean":"2024-04-15T23:38:35.721445+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:35.721445+0000","last_undegraded":"2024-04-15T23:38:35.721445+0000","last_fullsized":"2024-04-15T23:38:35.721445+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'220","last_scrub_stamp":"2024-04-15T23:38:35.721348+0000","last_deep_scrub":"79'220","last_deep_scrub_stamp":"2024-04-15T23:38:35.721348+0000","last_clean_scrub_stamp":"2024-04-15T23:38:35.721348+0000","objects_scrubbed":60,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:36.042951+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"79'6","reported_seq":166,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.527158+0000","last_change":"2024-04-15T23:38:18.527190+0000","last_active":"2024-04-15T23:38:18.527158+0000","last_peered":"2024-04-15T23:38:18.527158+0000","last_clean":"2024-04-15T23:38:18.527158+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:18.527158+0000","last_undegraded":"2024-04-15T23:38:18.527158+0000","last_fullsized":"2024-04-15T23:38:18.527158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-15T23:38:18.527070+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-15T23:38:18.527070+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.527070+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:03:39.532930+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"79'213","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:30.225509+0000","last_change":"2024-04-15T23:38:30.225535+0000","last_active":"2024-04-15T23:38:30.225509+0000","last_peered":"2024-04-15T23:38:30.225509+0000","last_clean":"2024-04-15T23:38:30.225509+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:30.225509+0000","last_undegraded":"2024-04-15T23:38:30.225509+0000","last_fullsized":"2024-04-15T23:38:30.225509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'213","last_scrub_stamp":"2024-04-15T23:38:30.225427+0000","last_deep_scrub":"79'213","last_deep_scrub_stamp":"2024-04-15T23:38:30.225427+0000","last_clean_scrub_stamp":"2024-04-15T23:38:30.225427+0000","objects_scrubbed":50,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:05.333778+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:34.185084+0000","last_change":"2024-04-15T23:38:34.185112+0000","last_active":"2024-04-15T23:38:34.185084+0000","last_peered":"2024-04-15T23:38:34.185084+0000","last_clean":"2024-04-15T23:38:34.185084+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:34.185084+0000","last_undegraded":"2024-04-15T23:38:34.185084+0000","last_fullsized":"2024-04-15T23:38:34.185084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:34.184998+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:34.184998+0000","last_clean_scrub_stamp":"2024-04-15T23:38:34.184998+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:17:31.864353+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"79'212","reported_seq":571,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:38.201820+0000","last_change":"2024-04-15T23:38:38.201869+0000","last_active":"2024-04-15T23:38:38.201820+0000","last_peered":"2024-04-15T23:38:38.201820+0000","last_clean":"2024-04-15T23:38:38.201820+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:38.201820+0000","last_undegraded":"2024-04-15T23:38:38.201820+0000","last_fullsized":"2024-04-15T23:38:38.201820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'212","last_scrub_stamp":"2024-04-15T23:38:38.201716+0000","last_deep_scrub":"79'212","last_deep_scrub_stamp":"2024-04-15T23:38:38.201716+0000","last_clean_scrub_stamp":"2024-04-15T23:38:38.201716+0000","objects_scrubbed":53,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:25:46.988099+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"79'62","reported_seq":222,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:42.790918+0000","last_change":"2024-04-15T23:38:42.790950+0000","last_active":"2024-04-15T23:38:42.790918+0000","last_peered":"2024-04-15T23:38:42.790918+0000","last_clean":"2024-04-15T23:38:42.790918+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:42.790918+0000","last_undegraded":"2024-04-15T23:38:42.790918+0000","last_fullsized":"2024-04-15T23:38:42.790918+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'62","last_scrub_stamp":"2024-04-15T23:38:42.790830+0000","last_deep_scrub":"79'62","last_deep_scrub_stamp":"2024-04-15T23:38:42.790830+0000","last_clean_scrub_stamp":"2024-04-15T23:38:42.790830+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:28:29.923687+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"79'226","reported_seq":603,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:32.692274+0000","last_change":"2024-04-15T23:38:32.692274+0000","last_active":"2024-04-15T23:38:32.692274+0000","last_peered":"2024-04-15T23:38:32.692274+0000","last_clean":"2024-04-15T23:38:32.692274+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:32.692274+0000","last_undegraded":"2024-04-15T23:38:32.692274+0000","last_fullsized":"2024-04-15T23:38:32.692274+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'226","last_scrub_stamp":"2024-04-15T23:38:32.692164+0000","last_deep_scrub":"79'226","last_deep_scrub_stamp":"2024-04-15T23:38:32.692164+0000","last_clean_scrub_stamp":"2024-04-15T23:38:32.692164+0000","objects_scrubbed":59,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:51:00.811729+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'3","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:35.911014+0000","last_change":"2024-04-15T23:38:35.911066+0000","last_active":"2024-04-15T23:38:35.911014+0000","last_peered":"2024-04-15T23:38:35.911014+0000","last_clean":"2024-04-15T23:38:35.911014+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:35.911014+0000","last_undegraded":"2024-04-15T23:38:35.911014+0000","last_fullsized":"2024-04-15T23:38:35.911014+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:35.910906+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:35.910906+0000","last_clean_scrub_stamp":"2024-04-15T23:38:35.910906+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:46:53.970048+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"79'254","reported_seq":653,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:32.280644+0000","last_change":"2024-04-15T23:38:32.280678+0000","last_active":"2024-04-15T23:38:32.280644+0000","last_peered":"2024-04-15T23:38:32.280644+0000","last_clean":"2024-04-15T23:38:32.280644+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:32.280644+0000","last_undegraded":"2024-04-15T23:38:32.280644+0000","last_fullsized":"2024-04-15T23:38:32.280644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'254","last_scrub_stamp":"2024-04-15T23:38:32.280552+0000","last_deep_scrub":"79'254","last_deep_scrub_stamp":"2024-04-15T23:38:32.280552+0000","last_clean_scrub_stamp":"2024-04-15T23:38:32.280552+0000","objects_scrubbed":65,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:55:39.436588+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'12","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.765908+0000","last_change":"2024-04-15T23:38:26.765936+0000","last_active":"2024-04-15T23:38:26.765908+0000","last_peered":"2024-04-15T23:38:26.765908+0000","last_clean":"2024-04-15T23:38:26.765908+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:26.765908+0000","last_undegraded":"2024-04-15T23:38:26.765908+0000","last_fullsized":"2024-04-15T23:38:26.765908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-15T23:38:26.765822+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-15T23:38:26.765822+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.765822+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:04:28.076591+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13811,"ondisk_log_size":13811,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":464,"ondisk_log_size":464,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103215,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77084,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94294756,"statfs":{"total":96636764160,"available":96557830144,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":32433383},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645325,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85136,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":32571,"kb_avail":94286704,"statfs":{"total":96636764160,"available":96549584896,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":33353091},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93080,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94278760,"statfs":{"total":96636764160,"available":96541450240,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:38:52.201 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-15T23:31:29.854434+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=31, tm_sec=29, tm_wday=0, tm_yday=106, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=15, tm_hour=23, tm_min=38, tm_sec=8, tm_wday=0, tm_yday=106, tm_isdst=0) 2024-04-15T23:38:52.202 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-15T23:39:12.204 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-15T23:39:12.513 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:39:12.515 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-04-15T23:39:12.523 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-04-15T23:39:11.896839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68767978,"num_objects":3481,"num_object_clones":0,"num_object_copies":6962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3481,"num_whiteouts":0,"num_read":170,"num_read_kb":462,"num_write":11260,"num_write_kb":83791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3185,"num_bytes_recovered":31812335,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14484,"ondisk_log_size":14484,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":255300,"kb_used_data":155628,"kb_used_omap":76,"kb_used_meta":99571,"kb_avail":282860220,"statfs":{"total":289910292480,"available":289648865280,"internally_reserved":0,"allocated":159363072,"data_stored":138199518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":78801,"internal_metadata":101960751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002671"},"pg_stats":[{"pgid":"4.3f","version":"79'211","reported_seq":576,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.630468+0000","last_change":"2024-04-15T23:38:27.630503+0000","last_active":"2024-04-15T23:38:27.630468+0000","last_peered":"2024-04-15T23:38:27.630468+0000","last_clean":"2024-04-15T23:38:27.630468+0000","last_became_active":"2024-04-15T23:35:13.299385+0000","last_became_peered":"2024-04-15T23:35:13.299385+0000","last_unstale":"2024-04-15T23:38:27.630468+0000","last_undegraded":"2024-04-15T23:38:27.630468+0000","last_fullsized":"2024-04-15T23:38:27.630468+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:27.630388+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:27.630388+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.630388+0000","objects_scrubbed":59,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:51:05.111250+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359511,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":359511,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"79'198","reported_seq":552,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.571390+0000","last_change":"2024-04-15T23:38:17.571459+0000","last_active":"2024-04-15T23:38:17.571390+0000","last_peered":"2024-04-15T23:38:17.571390+0000","last_clean":"2024-04-15T23:38:17.571390+0000","last_became_active":"2024-04-15T23:35:15.303334+0000","last_became_peered":"2024-04-15T23:35:15.303334+0000","last_unstale":"2024-04-15T23:38:17.571390+0000","last_undegraded":"2024-04-15T23:38:17.571390+0000","last_fullsized":"2024-04-15T23:38:17.571390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'198","last_scrub_stamp":"2024-04-15T23:38:17.571310+0000","last_deep_scrub":"79'198","last_deep_scrub_stamp":"2024-04-15T23:38:17.571310+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.571310+0000","objects_scrubbed":48,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:00:50.447066+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83633,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":83633,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"79'219","reported_seq":341,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:48.202617+0000","last_change":"2024-04-15T23:38:48.202664+0000","last_active":"2024-04-15T23:38:48.202617+0000","last_peered":"2024-04-15T23:38:48.202617+0000","last_clean":"2024-04-15T23:38:48.202617+0000","last_became_active":"2024-04-15T23:37:54.982004+0000","last_became_peered":"2024-04-15T23:37:54.982004+0000","last_unstale":"2024-04-15T23:38:48.202617+0000","last_undegraded":"2024-04-15T23:38:48.202617+0000","last_fullsized":"2024-04-15T23:38:48.202617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'219","last_scrub_stamp":"2024-04-15T23:38:48.202537+0000","last_deep_scrub":"79'219","last_deep_scrub_stamp":"2024-04-15T23:38:48.202537+0000","last_clean_scrub_stamp":"2024-04-15T23:38:48.202537+0000","objects_scrubbed":50,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:01:20.639556+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68109,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3c","version":"79'176","reported_seq":504,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:35.262816+0000","last_change":"2024-04-15T23:38:35.262856+0000","last_active":"2024-04-15T23:38:35.262816+0000","last_peered":"2024-04-15T23:38:35.262816+0000","last_clean":"2024-04-15T23:38:35.262816+0000","last_became_active":"2024-04-15T23:37:54.967671+0000","last_became_peered":"2024-04-15T23:37:54.967671+0000","last_unstale":"2024-04-15T23:38:35.262816+0000","last_undegraded":"2024-04-15T23:38:35.262816+0000","last_fullsized":"2024-04-15T23:38:35.262816+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'176","last_scrub_stamp":"2024-04-15T23:38:35.262725+0000","last_deep_scrub":"79'176","last_deep_scrub_stamp":"2024-04-15T23:38:35.262725+0000","last_clean_scrub_stamp":"2024-04-15T23:38:35.262725+0000","objects_scrubbed":48,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:29:15.724758+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145667,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"79'246","reported_seq":653,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.598587+0000","last_change":"2024-04-15T23:38:21.598587+0000","last_active":"2024-04-15T23:38:21.598587+0000","last_peered":"2024-04-15T23:38:21.598587+0000","last_clean":"2024-04-15T23:38:21.598587+0000","last_became_active":"2024-04-15T23:35:15.300226+0000","last_became_peered":"2024-04-15T23:35:15.300226+0000","last_unstale":"2024-04-15T23:38:21.598587+0000","last_undegraded":"2024-04-15T23:38:21.598587+0000","last_fullsized":"2024-04-15T23:38:21.598587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'246","last_scrub_stamp":"2024-04-15T23:38:21.598451+0000","last_deep_scrub":"79'246","last_deep_scrub_stamp":"2024-04-15T23:38:21.598451+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.598451+0000","objects_scrubbed":73,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:29:52.961528+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417204,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":417199,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"79'224","reported_seq":599,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:40.158276+0000","last_change":"2024-04-15T23:38:40.158313+0000","last_active":"2024-04-15T23:38:40.158276+0000","last_peered":"2024-04-15T23:38:40.158276+0000","last_clean":"2024-04-15T23:38:40.158276+0000","last_became_active":"2024-04-15T23:37:54.969774+0000","last_became_peered":"2024-04-15T23:37:54.969774+0000","last_unstale":"2024-04-15T23:38:40.158276+0000","last_undegraded":"2024-04-15T23:38:40.158276+0000","last_fullsized":"2024-04-15T23:38:40.158276+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'224","last_scrub_stamp":"2024-04-15T23:38:40.158198+0000","last_deep_scrub":"79'224","last_deep_scrub_stamp":"2024-04-15T23:38:40.158198+0000","last_clean_scrub_stamp":"2024-04-15T23:38:40.158198+0000","objects_scrubbed":51,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:43:05.905755+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182889,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"79'225","reported_seq":598,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:36.284901+0000","last_change":"2024-04-15T23:38:36.284940+0000","last_active":"2024-04-15T23:38:36.284901+0000","last_peered":"2024-04-15T23:38:36.284901+0000","last_clean":"2024-04-15T23:38:36.284901+0000","last_became_active":"2024-04-15T23:37:54.968969+0000","last_became_peered":"2024-04-15T23:37:54.968969+0000","last_unstale":"2024-04-15T23:38:36.284901+0000","last_undegraded":"2024-04-15T23:38:36.284901+0000","last_fullsized":"2024-04-15T23:38:36.284901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'225","last_scrub_stamp":"2024-04-15T23:38:36.284812+0000","last_deep_scrub":"79'225","last_deep_scrub_stamp":"2024-04-15T23:38:36.284812+0000","last_clean_scrub_stamp":"2024-04-15T23:38:36.284812+0000","objects_scrubbed":59,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:22:05.742306+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":274228,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"79'181","reported_seq":509,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.198939+0000","last_change":"2024-04-15T23:38:16.198976+0000","last_active":"2024-04-15T23:38:16.198939+0000","last_peered":"2024-04-15T23:38:16.198939+0000","last_clean":"2024-04-15T23:38:16.198939+0000","last_became_active":"2024-04-15T23:37:54.973701+0000","last_became_peered":"2024-04-15T23:37:54.973701+0000","last_unstale":"2024-04-15T23:38:16.198939+0000","last_undegraded":"2024-04-15T23:38:16.198939+0000","last_fullsized":"2024-04-15T23:38:16.198939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'181","last_scrub_stamp":"2024-04-15T23:38:16.198855+0000","last_deep_scrub":"79'181","last_deep_scrub_stamp":"2024-04-15T23:38:16.198855+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.198855+0000","objects_scrubbed":38,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:22:15.134238+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98267,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"79'223","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.911672+0000","last_change":"2024-04-15T23:38:15.911705+0000","last_active":"2024-04-15T23:38:15.911672+0000","last_peered":"2024-04-15T23:38:15.911672+0000","last_clean":"2024-04-15T23:38:15.911672+0000","last_became_active":"2024-04-15T23:35:14.299623+0000","last_became_peered":"2024-04-15T23:35:14.299623+0000","last_unstale":"2024-04-15T23:38:15.911672+0000","last_undegraded":"2024-04-15T23:38:15.911672+0000","last_fullsized":"2024-04-15T23:38:15.911672+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'223","last_scrub_stamp":"2024-04-15T23:38:15.911586+0000","last_deep_scrub":"79'223","last_deep_scrub_stamp":"2024-04-15T23:38:15.911586+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.911586+0000","objects_scrubbed":56,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:07:16.333575+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118902,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":180,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":110521,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"79'204","reported_seq":555,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.560530+0000","last_change":"2024-04-15T23:38:15.560530+0000","last_active":"2024-04-15T23:38:15.560530+0000","last_peered":"2024-04-15T23:38:15.560530+0000","last_clean":"2024-04-15T23:38:15.560530+0000","last_became_active":"2024-04-15T23:35:16.298082+0000","last_became_peered":"2024-04-15T23:35:16.298082+0000","last_unstale":"2024-04-15T23:38:15.560530+0000","last_undegraded":"2024-04-15T23:38:15.560530+0000","last_fullsized":"2024-04-15T23:38:15.560530+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'204","last_scrub_stamp":"2024-04-15T23:38:15.560419+0000","last_deep_scrub":"79'204","last_deep_scrub_stamp":"2024-04-15T23:38:15.560419+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.560419+0000","objects_scrubbed":52,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:06:57.938678+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110621,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":105933,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"79'212","reported_seq":567,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:37.244297+0000","last_change":"2024-04-15T23:38:37.244331+0000","last_active":"2024-04-15T23:38:37.244297+0000","last_peered":"2024-04-15T23:38:37.244297+0000","last_clean":"2024-04-15T23:38:37.244297+0000","last_became_active":"2024-04-15T23:37:54.969705+0000","last_became_peered":"2024-04-15T23:37:54.969705+0000","last_unstale":"2024-04-15T23:38:37.244297+0000","last_undegraded":"2024-04-15T23:38:37.244297+0000","last_fullsized":"2024-04-15T23:38:37.244297+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'212","last_scrub_stamp":"2024-04-15T23:38:37.244219+0000","last_deep_scrub":"79'212","last_deep_scrub_stamp":"2024-04-15T23:38:37.244219+0000","last_clean_scrub_stamp":"2024-04-15T23:38:37.244219+0000","objects_scrubbed":61,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:37:35.664144+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192323,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"79'190","reported_seq":350,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.599730+0000","last_change":"2024-04-15T23:38:20.599730+0000","last_active":"2024-04-15T23:38:20.599730+0000","last_peered":"2024-04-15T23:38:20.599730+0000","last_clean":"2024-04-15T23:38:20.599730+0000","last_became_active":"2024-04-15T23:37:54.979851+0000","last_became_peered":"2024-04-15T23:37:54.979851+0000","last_unstale":"2024-04-15T23:38:20.599730+0000","last_undegraded":"2024-04-15T23:38:20.599730+0000","last_fullsized":"2024-04-15T23:38:20.599730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'190","last_scrub_stamp":"2024-04-15T23:38:20.599599+0000","last_deep_scrub":"79'190","last_deep_scrub_stamp":"2024-04-15T23:38:20.599599+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.599599+0000","objects_scrubbed":49,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:18:50.442189+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91424,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"79'185","reported_seq":524,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.554098+0000","last_change":"2024-04-15T23:38:25.554098+0000","last_active":"2024-04-15T23:38:25.554098+0000","last_peered":"2024-04-15T23:38:25.554098+0000","last_clean":"2024-04-15T23:38:25.554098+0000","last_became_active":"2024-04-15T23:35:14.299120+0000","last_became_peered":"2024-04-15T23:35:14.299120+0000","last_unstale":"2024-04-15T23:38:25.554098+0000","last_undegraded":"2024-04-15T23:38:25.554098+0000","last_fullsized":"2024-04-15T23:38:25.554098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'185","last_scrub_stamp":"2024-04-15T23:38:25.553900+0000","last_deep_scrub":"79'185","last_deep_scrub_stamp":"2024-04-15T23:38:25.553900+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.553900+0000","objects_scrubbed":50,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:46:37.589815+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99589,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":99589,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"79'215","reported_seq":336,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:43.119624+0000","last_change":"2024-04-15T23:38:43.119662+0000","last_active":"2024-04-15T23:38:43.119624+0000","last_peered":"2024-04-15T23:38:43.119624+0000","last_clean":"2024-04-15T23:38:43.119624+0000","last_became_active":"2024-04-15T23:37:54.977994+0000","last_became_peered":"2024-04-15T23:37:54.977994+0000","last_unstale":"2024-04-15T23:38:43.119624+0000","last_undegraded":"2024-04-15T23:38:43.119624+0000","last_fullsized":"2024-04-15T23:38:43.119624+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:43.119543+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:43.119543+0000","last_clean_scrub_stamp":"2024-04-15T23:38:43.119543+0000","objects_scrubbed":38,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:12:23.400119+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74788,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"79'210","reported_seq":327,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:41.182378+0000","last_change":"2024-04-15T23:38:41.182414+0000","last_active":"2024-04-15T23:38:41.182378+0000","last_peered":"2024-04-15T23:38:41.182378+0000","last_clean":"2024-04-15T23:38:41.182378+0000","last_became_active":"2024-04-15T23:37:54.975938+0000","last_became_peered":"2024-04-15T23:37:54.975938+0000","last_unstale":"2024-04-15T23:38:41.182378+0000","last_undegraded":"2024-04-15T23:38:41.182378+0000","last_fullsized":"2024-04-15T23:38:41.182378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:41.182303+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:41.182303+0000","last_clean_scrub_stamp":"2024-04-15T23:38:41.182303+0000","objects_scrubbed":53,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:00:43.323595+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86116,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"79'235","reported_seq":616,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.239095+0000","last_change":"2024-04-15T23:38:25.239126+0000","last_active":"2024-04-15T23:38:25.239095+0000","last_peered":"2024-04-15T23:38:25.239095+0000","last_clean":"2024-04-15T23:38:25.239095+0000","last_became_active":"2024-04-15T23:37:54.970001+0000","last_became_peered":"2024-04-15T23:37:54.970001+0000","last_unstale":"2024-04-15T23:38:25.239095+0000","last_undegraded":"2024-04-15T23:38:25.239095+0000","last_fullsized":"2024-04-15T23:38:25.239095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'235","last_scrub_stamp":"2024-04-15T23:38:25.239007+0000","last_deep_scrub":"79'235","last_deep_scrub_stamp":"2024-04-15T23:38:25.239007+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.239007+0000","objects_scrubbed":58,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:37:33.687493+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1496530,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":1625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"79'210","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.916926+0000","last_change":"2024-04-15T23:38:19.917011+0000","last_active":"2024-04-15T23:38:19.916926+0000","last_peered":"2024-04-15T23:38:19.916926+0000","last_clean":"2024-04-15T23:38:19.916926+0000","last_became_active":"2024-04-15T23:35:13.297769+0000","last_became_peered":"2024-04-15T23:35:13.297769+0000","last_unstale":"2024-04-15T23:38:19.916926+0000","last_undegraded":"2024-04-15T23:38:19.916926+0000","last_fullsized":"2024-04-15T23:38:19.916926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:19.916824+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:19.916824+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.916824+0000","objects_scrubbed":45,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:32:11.979533+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125396,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":118304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"79'199","reported_seq":551,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.548615+0000","last_change":"2024-04-15T23:38:13.548615+0000","last_active":"2024-04-15T23:38:13.548615+0000","last_peered":"2024-04-15T23:38:13.548615+0000","last_clean":"2024-04-15T23:38:13.548615+0000","last_became_active":"2024-04-15T23:35:16.298936+0000","last_became_peered":"2024-04-15T23:35:16.298936+0000","last_unstale":"2024-04-15T23:38:13.548615+0000","last_undegraded":"2024-04-15T23:38:13.548615+0000","last_fullsized":"2024-04-15T23:38:13.548615+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'199","last_scrub_stamp":"2024-04-15T23:38:13.548455+0000","last_deep_scrub":"79'199","last_deep_scrub_stamp":"2024-04-15T23:38:13.548455+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.548455+0000","objects_scrubbed":49,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:38:42.034985+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4310518,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":4310518,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"79'202","reported_seq":321,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.876451+0000","last_change":"2024-04-15T23:38:14.876516+0000","last_active":"2024-04-15T23:38:14.876451+0000","last_peered":"2024-04-15T23:38:14.876451+0000","last_clean":"2024-04-15T23:38:14.876451+0000","last_became_active":"2024-04-15T23:35:16.297935+0000","last_became_peered":"2024-04-15T23:35:16.297935+0000","last_unstale":"2024-04-15T23:38:14.876451+0000","last_undegraded":"2024-04-15T23:38:14.876451+0000","last_fullsized":"2024-04-15T23:38:14.876451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:14.876346+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:14.876346+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.876346+0000","objects_scrubbed":58,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:05:20.121682+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136726,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":136713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"79'254","reported_seq":635,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.283040+0000","last_change":"2024-04-15T23:38:26.283108+0000","last_active":"2024-04-15T23:38:26.283040+0000","last_peered":"2024-04-15T23:38:26.283040+0000","last_clean":"2024-04-15T23:38:26.283040+0000","last_became_active":"2024-04-15T23:37:54.971358+0000","last_became_peered":"2024-04-15T23:37:54.971358+0000","last_unstale":"2024-04-15T23:38:26.283040+0000","last_undegraded":"2024-04-15T23:38:26.283040+0000","last_fullsized":"2024-04-15T23:38:26.283040+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'254","last_scrub_stamp":"2024-04-15T23:38:26.282946+0000","last_deep_scrub":"79'254","last_deep_scrub_stamp":"2024-04-15T23:38:26.282946+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.282946+0000","objects_scrubbed":56,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:12:18.574118+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":244249,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":187,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"79'216","reported_seq":581,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.217122+0000","last_change":"2024-04-15T23:38:18.217155+0000","last_active":"2024-04-15T23:38:18.217122+0000","last_peered":"2024-04-15T23:38:18.217122+0000","last_clean":"2024-04-15T23:38:18.217122+0000","last_became_active":"2024-04-15T23:37:54.970226+0000","last_became_peered":"2024-04-15T23:37:54.970226+0000","last_unstale":"2024-04-15T23:38:18.217122+0000","last_undegraded":"2024-04-15T23:38:18.217122+0000","last_fullsized":"2024-04-15T23:38:18.217122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:18.217043+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:18.217043+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.217043+0000","objects_scrubbed":54,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:34:28.568592+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87443,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"79'226","reported_seq":387,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:10.521308+0000","last_change":"2024-04-15T23:38:10.521308+0000","last_active":"2024-04-15T23:38:10.521308+0000","last_peered":"2024-04-15T23:38:10.521308+0000","last_clean":"2024-04-15T23:38:10.521308+0000","last_became_active":"2024-04-15T23:37:54.982653+0000","last_became_peered":"2024-04-15T23:37:54.982653+0000","last_unstale":"2024-04-15T23:38:10.521308+0000","last_undegraded":"2024-04-15T23:38:10.521308+0000","last_fullsized":"2024-04-15T23:38:10.521308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'226","last_scrub_stamp":"2024-04-15T23:38:10.521192+0000","last_deep_scrub":"79'226","last_deep_scrub_stamp":"2024-04-15T23:38:10.521192+0000","last_clean_scrub_stamp":"2024-04-15T23:38:10.521192+0000","objects_scrubbed":56,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:16:05.818704+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198586,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"79'211","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.815788+0000","last_change":"2024-04-15T23:38:24.815832+0000","last_active":"2024-04-15T23:38:24.815788+0000","last_peered":"2024-04-15T23:38:24.815788+0000","last_clean":"2024-04-15T23:38:24.815788+0000","last_became_active":"2024-04-15T23:37:54.969334+0000","last_became_peered":"2024-04-15T23:37:54.969334+0000","last_unstale":"2024-04-15T23:38:24.815788+0000","last_undegraded":"2024-04-15T23:38:24.815788+0000","last_fullsized":"2024-04-15T23:38:24.815788+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:24.815711+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:24.815711+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.815711+0000","objects_scrubbed":49,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:16:17.481087+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87117,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":87117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"79'218","reported_seq":593,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:31.703061+0000","last_change":"2024-04-15T23:38:31.703094+0000","last_active":"2024-04-15T23:38:31.703061+0000","last_peered":"2024-04-15T23:38:31.703061+0000","last_clean":"2024-04-15T23:38:31.703061+0000","last_became_active":"2024-04-15T23:35:10.298686+0000","last_became_peered":"2024-04-15T23:35:10.298686+0000","last_unstale":"2024-04-15T23:38:31.703061+0000","last_undegraded":"2024-04-15T23:38:31.703061+0000","last_fullsized":"2024-04-15T23:38:31.703061+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'218","last_scrub_stamp":"2024-04-15T23:38:31.702974+0000","last_deep_scrub":"79'218","last_deep_scrub_stamp":"2024-04-15T23:38:31.702974+0000","last_clean_scrub_stamp":"2024-04-15T23:38:31.702974+0000","objects_scrubbed":53,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:16:54.148300+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148133,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":142060,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"79'215","reported_seq":376,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.531291+0000","last_change":"2024-04-15T23:38:14.531324+0000","last_active":"2024-04-15T23:38:14.531291+0000","last_peered":"2024-04-15T23:38:14.531291+0000","last_clean":"2024-04-15T23:38:14.531291+0000","last_became_active":"2024-04-15T23:37:54.979060+0000","last_became_peered":"2024-04-15T23:37:54.979060+0000","last_unstale":"2024-04-15T23:38:14.531291+0000","last_undegraded":"2024-04-15T23:38:14.531291+0000","last_fullsized":"2024-04-15T23:38:14.531291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:14.531213+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:14.531213+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.531213+0000","objects_scrubbed":59,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:03:23.389467+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629935,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":171,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"79'249","reported_seq":375,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:38.880970+0000","last_change":"2024-04-15T23:38:38.881045+0000","last_active":"2024-04-15T23:38:38.880970+0000","last_peered":"2024-04-15T23:38:38.880970+0000","last_clean":"2024-04-15T23:38:38.880970+0000","last_became_active":"2024-04-15T23:37:54.971768+0000","last_became_peered":"2024-04-15T23:37:54.971768+0000","last_unstale":"2024-04-15T23:38:38.880970+0000","last_undegraded":"2024-04-15T23:38:38.880970+0000","last_fullsized":"2024-04-15T23:38:38.880970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'249","last_scrub_stamp":"2024-04-15T23:38:38.880879+0000","last_deep_scrub":"79'249","last_deep_scrub_stamp":"2024-04-15T23:38:38.880879+0000","last_clean_scrub_stamp":"2024-04-15T23:38:38.880879+0000","objects_scrubbed":59,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:23:10.587111+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105845,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":202,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":105807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"79'206","reported_seq":323,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:47.173908+0000","last_change":"2024-04-15T23:38:47.173999+0000","last_active":"2024-04-15T23:38:47.173908+0000","last_peered":"2024-04-15T23:38:47.173908+0000","last_clean":"2024-04-15T23:38:47.173908+0000","last_became_active":"2024-04-15T23:37:54.981354+0000","last_became_peered":"2024-04-15T23:37:54.981354+0000","last_unstale":"2024-04-15T23:38:47.173908+0000","last_undegraded":"2024-04-15T23:38:47.173908+0000","last_fullsized":"2024-04-15T23:38:47.173908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'206","last_scrub_stamp":"2024-04-15T23:38:47.173805+0000","last_deep_scrub":"79'206","last_deep_scrub_stamp":"2024-04-15T23:38:47.173805+0000","last_clean_scrub_stamp":"2024-04-15T23:38:47.173805+0000","objects_scrubbed":46,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:58:15.691815+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":489037,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"79'193","reported_seq":353,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:37.733627+0000","last_change":"2024-04-15T23:38:37.733667+0000","last_active":"2024-04-15T23:38:37.733627+0000","last_peered":"2024-04-15T23:38:37.733627+0000","last_clean":"2024-04-15T23:38:37.733627+0000","last_became_active":"2024-04-15T23:37:54.980043+0000","last_became_peered":"2024-04-15T23:37:54.980043+0000","last_unstale":"2024-04-15T23:38:37.733627+0000","last_undegraded":"2024-04-15T23:38:37.733627+0000","last_fullsized":"2024-04-15T23:38:37.733627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'193","last_scrub_stamp":"2024-04-15T23:38:37.733547+0000","last_deep_scrub":"79'193","last_deep_scrub_stamp":"2024-04-15T23:38:37.733547+0000","last_clean_scrub_stamp":"2024-04-15T23:38:37.733547+0000","objects_scrubbed":42,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:25:23.070600+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91883,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"79'222","reported_seq":343,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.934383+0000","last_change":"2024-04-15T23:38:12.934414+0000","last_active":"2024-04-15T23:38:12.934383+0000","last_peered":"2024-04-15T23:38:12.934383+0000","last_clean":"2024-04-15T23:38:12.934383+0000","last_became_active":"2024-04-15T23:35:15.295363+0000","last_became_peered":"2024-04-15T23:35:15.295363+0000","last_unstale":"2024-04-15T23:38:12.934383+0000","last_undegraded":"2024-04-15T23:38:12.934383+0000","last_fullsized":"2024-04-15T23:38:12.934383+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'222","last_scrub_stamp":"2024-04-15T23:38:12.934301+0000","last_deep_scrub":"79'222","last_deep_scrub_stamp":"2024-04-15T23:38:12.934301+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.934301+0000","objects_scrubbed":55,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:53:01.608980+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4342001,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":4405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4342001,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"79'255","reported_seq":416,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:40.779529+0000","last_change":"2024-04-15T23:38:40.779572+0000","last_active":"2024-04-15T23:38:40.779529+0000","last_peered":"2024-04-15T23:38:40.779529+0000","last_clean":"2024-04-15T23:38:40.779529+0000","last_became_active":"2024-04-15T23:37:54.982554+0000","last_became_peered":"2024-04-15T23:37:54.982554+0000","last_unstale":"2024-04-15T23:38:40.779529+0000","last_undegraded":"2024-04-15T23:38:40.779529+0000","last_fullsized":"2024-04-15T23:38:40.779529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'255","last_scrub_stamp":"2024-04-15T23:38:40.779453+0000","last_deep_scrub":"79'255","last_deep_scrub_stamp":"2024-04-15T23:38:40.779453+0000","last_clean_scrub_stamp":"2024-04-15T23:38:40.779453+0000","objects_scrubbed":62,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:23:33.151712+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144733,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":213,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"79'252","reported_seq":383,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.824572+0000","last_change":"2024-04-15T23:38:27.824615+0000","last_active":"2024-04-15T23:38:27.824572+0000","last_peered":"2024-04-15T23:38:27.824572+0000","last_clean":"2024-04-15T23:38:27.824572+0000","last_became_active":"2024-04-15T23:35:10.298690+0000","last_became_peered":"2024-04-15T23:35:10.298690+0000","last_unstale":"2024-04-15T23:38:27.824572+0000","last_undegraded":"2024-04-15T23:38:27.824572+0000","last_fullsized":"2024-04-15T23:38:27.824572+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'252","last_scrub_stamp":"2024-04-15T23:38:27.824497+0000","last_deep_scrub":"79'252","last_deep_scrub_stamp":"2024-04-15T23:38:27.824497+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.824497+0000","objects_scrubbed":66,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:31:34.380602+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146312,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":178,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":146312,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"79'242","reported_seq":629,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.188900+0000","last_change":"2024-04-15T23:38:13.188939+0000","last_active":"2024-04-15T23:38:13.188900+0000","last_peered":"2024-04-15T23:38:13.188900+0000","last_clean":"2024-04-15T23:38:13.188900+0000","last_became_active":"2024-04-15T23:37:54.975167+0000","last_became_peered":"2024-04-15T23:37:54.975167+0000","last_unstale":"2024-04-15T23:38:13.188900+0000","last_undegraded":"2024-04-15T23:38:13.188900+0000","last_fullsized":"2024-04-15T23:38:13.188900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'242","last_scrub_stamp":"2024-04-15T23:38:13.188813+0000","last_deep_scrub":"79'242","last_deep_scrub_stamp":"2024-04-15T23:38:13.188813+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.188813+0000","objects_scrubbed":61,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:32:30.280122+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136364,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"79'199","reported_seq":549,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.598089+0000","last_change":"2024-04-15T23:38:23.598089+0000","last_active":"2024-04-15T23:38:23.598089+0000","last_peered":"2024-04-15T23:38:23.598089+0000","last_clean":"2024-04-15T23:38:23.598089+0000","last_became_active":"2024-04-15T23:35:14.299614+0000","last_became_peered":"2024-04-15T23:35:14.299614+0000","last_unstale":"2024-04-15T23:38:23.598089+0000","last_undegraded":"2024-04-15T23:38:23.598089+0000","last_fullsized":"2024-04-15T23:38:23.598089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'199","last_scrub_stamp":"2024-04-15T23:38:23.597922+0000","last_deep_scrub":"79'199","last_deep_scrub_stamp":"2024-04-15T23:38:23.597922+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.597922+0000","objects_scrubbed":46,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:51:09.121996+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":709473,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":709433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"79'134","reported_seq":290,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.199524+0000","last_change":"2024-04-15T23:38:28.199567+0000","last_active":"2024-04-15T23:38:28.199524+0000","last_peered":"2024-04-15T23:38:28.199524+0000","last_clean":"2024-04-15T23:38:28.199524+0000","last_became_active":"2024-04-15T23:37:54.973466+0000","last_became_peered":"2024-04-15T23:37:54.973466+0000","last_unstale":"2024-04-15T23:38:28.199524+0000","last_undegraded":"2024-04-15T23:38:28.199524+0000","last_fullsized":"2024-04-15T23:38:28.199524+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'134","last_scrub_stamp":"2024-04-15T23:38:28.199397+0000","last_deep_scrub":"79'134","last_deep_scrub_stamp":"2024-04-15T23:38:28.199397+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.199397+0000","objects_scrubbed":3,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:08:31.341770+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3518826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":3507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"79'193","reported_seq":543,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:34.736158+0000","last_change":"2024-04-15T23:38:34.736158+0000","last_active":"2024-04-15T23:38:34.736158+0000","last_peered":"2024-04-15T23:38:34.736158+0000","last_clean":"2024-04-15T23:38:34.736158+0000","last_became_active":"2024-04-15T23:35:12.300024+0000","last_became_peered":"2024-04-15T23:35:12.300024+0000","last_unstale":"2024-04-15T23:38:34.736158+0000","last_undegraded":"2024-04-15T23:38:34.736158+0000","last_fullsized":"2024-04-15T23:38:34.736158+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'193","last_scrub_stamp":"2024-04-15T23:38:34.735976+0000","last_deep_scrub":"79'193","last_deep_scrub_stamp":"2024-04-15T23:38:34.735976+0000","last_clean_scrub_stamp":"2024-04-15T23:38:34.735976+0000","objects_scrubbed":41,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:55:44.942188+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157925,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":152,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":157899,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:40.861122+0000","last_change":"2024-04-15T23:38:40.861149+0000","last_active":"2024-04-15T23:38:40.861122+0000","last_peered":"2024-04-15T23:38:40.861122+0000","last_clean":"2024-04-15T23:38:40.861122+0000","last_became_active":"2024-04-15T23:37:54.974110+0000","last_became_peered":"2024-04-15T23:37:54.974110+0000","last_unstale":"2024-04-15T23:38:40.861122+0000","last_undegraded":"2024-04-15T23:38:40.861122+0000","last_fullsized":"2024-04-15T23:38:40.861122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:40.861005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:40.861005+0000","last_clean_scrub_stamp":"2024-04-15T23:38:40.861005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:34:40.015234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"79'243","reported_seq":371,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.887241+0000","last_change":"2024-04-15T23:38:22.887269+0000","last_active":"2024-04-15T23:38:22.887241+0000","last_peered":"2024-04-15T23:38:22.887241+0000","last_clean":"2024-04-15T23:38:22.887241+0000","last_became_active":"2024-04-15T23:37:54.968731+0000","last_became_peered":"2024-04-15T23:37:54.968731+0000","last_unstale":"2024-04-15T23:38:22.887241+0000","last_undegraded":"2024-04-15T23:38:22.887241+0000","last_fullsized":"2024-04-15T23:38:22.887241+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'243","last_scrub_stamp":"2024-04-15T23:38:22.887161+0000","last_deep_scrub":"79'243","last_deep_scrub_stamp":"2024-04-15T23:38:22.887161+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.887161+0000","objects_scrubbed":51,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:43:24.550219+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135358,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":212,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":129487,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.553977+0000","last_change":"2024-04-15T23:38:16.553977+0000","last_active":"2024-04-15T23:38:16.553977+0000","last_peered":"2024-04-15T23:38:16.553977+0000","last_clean":"2024-04-15T23:38:16.553977+0000","last_became_active":"2024-04-15T23:37:54.974607+0000","last_became_peered":"2024-04-15T23:37:54.974607+0000","last_unstale":"2024-04-15T23:38:16.553977+0000","last_undegraded":"2024-04-15T23:38:16.553977+0000","last_fullsized":"2024-04-15T23:38:16.553977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:16.553862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:16.553862+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.553862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:08:22.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"79'217","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:39.871794+0000","last_change":"2024-04-15T23:38:39.871831+0000","last_active":"2024-04-15T23:38:39.871794+0000","last_peered":"2024-04-15T23:38:39.871794+0000","last_clean":"2024-04-15T23:38:39.871794+0000","last_became_active":"2024-04-15T23:37:54.972045+0000","last_became_peered":"2024-04-15T23:37:54.972045+0000","last_unstale":"2024-04-15T23:38:39.871794+0000","last_undegraded":"2024-04-15T23:38:39.871794+0000","last_fullsized":"2024-04-15T23:38:39.871794+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'217","last_scrub_stamp":"2024-04-15T23:38:39.871699+0000","last_deep_scrub":"79'217","last_deep_scrub_stamp":"2024-04-15T23:38:39.871699+0000","last_clean_scrub_stamp":"2024-04-15T23:38:39.871699+0000","objects_scrubbed":39,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:30:32.919486+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100068,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":100068,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"79'13","reported_seq":122,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.182671+0000","last_change":"2024-04-15T23:38:12.182714+0000","last_active":"2024-04-15T23:38:12.182671+0000","last_peered":"2024-04-15T23:38:12.182671+0000","last_clean":"2024-04-15T23:38:12.182671+0000","last_became_active":"2024-04-15T23:37:54.978324+0000","last_became_peered":"2024-04-15T23:37:54.978324+0000","last_unstale":"2024-04-15T23:38:12.182671+0000","last_undegraded":"2024-04-15T23:38:12.182671+0000","last_fullsized":"2024-04-15T23:38:12.182671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'13","last_scrub_stamp":"2024-04-15T23:38:12.182588+0000","last_deep_scrub":"79'13","last_deep_scrub_stamp":"2024-04-15T23:38:12.182588+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.182588+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:40:29.437300+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"79'2","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:31.234015+0000","last_change":"2024-04-15T23:38:31.234057+0000","last_active":"2024-04-15T23:38:31.234015+0000","last_peered":"2024-04-15T23:38:31.234015+0000","last_clean":"2024-04-15T23:38:31.234015+0000","last_became_active":"2024-04-15T23:37:54.977401+0000","last_became_peered":"2024-04-15T23:37:54.977401+0000","last_unstale":"2024-04-15T23:38:31.234015+0000","last_undegraded":"2024-04-15T23:38:31.234015+0000","last_fullsized":"2024-04-15T23:38:31.234015+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-15T23:38:31.233892+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-15T23:38:31.233892+0000","last_clean_scrub_stamp":"2024-04-15T23:38:31.233892+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:55:53.883142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"79'209","reported_seq":370,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:12.568416+0000","last_change":"2024-04-15T23:38:12.568452+0000","last_active":"2024-04-15T23:38:12.568416+0000","last_peered":"2024-04-15T23:38:12.568416+0000","last_clean":"2024-04-15T23:38:12.568416+0000","last_became_active":"2024-04-15T23:37:54.979130+0000","last_became_peered":"2024-04-15T23:37:54.979130+0000","last_unstale":"2024-04-15T23:38:12.568416+0000","last_undegraded":"2024-04-15T23:38:12.568416+0000","last_fullsized":"2024-04-15T23:38:12.568416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'209","last_scrub_stamp":"2024-04-15T23:38:12.568335+0000","last_deep_scrub":"79'209","last_deep_scrub_stamp":"2024-04-15T23:38:12.568335+0000","last_clean_scrub_stamp":"2024-04-15T23:38:12.568335+0000","objects_scrubbed":56,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:18:16.914156+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142895,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"79'4","reported_seq":165,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:36.673768+0000","last_change":"2024-04-15T23:38:36.673801+0000","last_active":"2024-04-15T23:38:36.673768+0000","last_peered":"2024-04-15T23:38:36.673768+0000","last_clean":"2024-04-15T23:38:36.673768+0000","last_became_active":"2024-04-15T23:37:54.983423+0000","last_became_peered":"2024-04-15T23:37:54.983423+0000","last_unstale":"2024-04-15T23:38:36.673768+0000","last_undegraded":"2024-04-15T23:38:36.673768+0000","last_fullsized":"2024-04-15T23:38:36.673768+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'4","last_scrub_stamp":"2024-04-15T23:38:36.673679+0000","last_deep_scrub":"79'4","last_deep_scrub_stamp":"2024-04-15T23:38:36.673679+0000","last_clean_scrub_stamp":"2024-04-15T23:38:36.673679+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:11:34.471554+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"79'231","reported_seq":631,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:33.697587+0000","last_change":"2024-04-15T23:38:33.697621+0000","last_active":"2024-04-15T23:38:33.697587+0000","last_peered":"2024-04-15T23:38:33.697587+0000","last_clean":"2024-04-15T23:38:33.697587+0000","last_became_active":"2024-04-15T23:35:12.296375+0000","last_became_peered":"2024-04-15T23:35:12.296375+0000","last_unstale":"2024-04-15T23:38:33.697587+0000","last_undegraded":"2024-04-15T23:38:33.697587+0000","last_fullsized":"2024-04-15T23:38:33.697587+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'231","last_scrub_stamp":"2024-04-15T23:38:33.697505+0000","last_deep_scrub":"79'231","last_deep_scrub_stamp":"2024-04-15T23:38:33.697505+0000","last_clean_scrub_stamp":"2024-04-15T23:38:33.697505+0000","objects_scrubbed":54,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:04:12.540641+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145745,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":193,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":136665,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"79'2","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:44.104115+0000","last_change":"2024-04-15T23:38:44.104160+0000","last_active":"2024-04-15T23:38:44.104115+0000","last_peered":"2024-04-15T23:38:44.104115+0000","last_clean":"2024-04-15T23:38:44.104115+0000","last_became_active":"2024-04-15T23:37:54.978989+0000","last_became_peered":"2024-04-15T23:37:54.978989+0000","last_unstale":"2024-04-15T23:38:44.104115+0000","last_undegraded":"2024-04-15T23:38:44.104115+0000","last_fullsized":"2024-04-15T23:38:44.104115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'2","last_scrub_stamp":"2024-04-15T23:38:44.104008+0000","last_deep_scrub":"79'2","last_deep_scrub_stamp":"2024-04-15T23:38:44.104008+0000","last_clean_scrub_stamp":"2024-04-15T23:38:44.104008+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:44:09.098063+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"79'202","reported_seq":557,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.220318+0000","last_change":"2024-04-15T23:38:19.220351+0000","last_active":"2024-04-15T23:38:19.220318+0000","last_peered":"2024-04-15T23:38:19.220318+0000","last_clean":"2024-04-15T23:38:19.220318+0000","last_became_active":"2024-04-15T23:37:54.973064+0000","last_became_peered":"2024-04-15T23:37:54.973064+0000","last_unstale":"2024-04-15T23:38:19.220318+0000","last_undegraded":"2024-04-15T23:38:19.220318+0000","last_fullsized":"2024-04-15T23:38:19.220318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:19.220237+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:19.220237+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.220237+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:58:12.248305+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66517,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"50'1","reported_seq":144,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.190109+0000","last_change":"2024-04-15T23:38:22.190134+0000","last_active":"2024-04-15T23:38:22.190109+0000","last_peered":"2024-04-15T23:38:22.190109+0000","last_clean":"2024-04-15T23:38:22.190109+0000","last_became_active":"2024-04-15T23:37:54.971888+0000","last_became_peered":"2024-04-15T23:37:54.971888+0000","last_unstale":"2024-04-15T23:38:22.190109+0000","last_undegraded":"2024-04-15T23:38:22.190109+0000","last_fullsized":"2024-04-15T23:38:22.190109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'1","last_scrub_stamp":"2024-04-15T23:38:22.190022+0000","last_deep_scrub":"50'1","last_deep_scrub_stamp":"2024-04-15T23:38:22.190022+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.190022+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:57:51.403732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"79'216","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:43.868215+0000","last_change":"2024-04-15T23:38:43.868250+0000","last_active":"2024-04-15T23:38:43.868215+0000","last_peered":"2024-04-15T23:38:43.868215+0000","last_clean":"2024-04-15T23:38:43.868215+0000","last_became_active":"2024-04-15T23:37:54.979153+0000","last_became_peered":"2024-04-15T23:37:54.979153+0000","last_unstale":"2024-04-15T23:38:43.868215+0000","last_undegraded":"2024-04-15T23:38:43.868215+0000","last_fullsized":"2024-04-15T23:38:43.868215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:43.868138+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:43.868138+0000","last_clean_scrub_stamp":"2024-04-15T23:38:43.868138+0000","objects_scrubbed":60,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:21:29.518202+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113295,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":155,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":113240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'9","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:36.904358+0000","last_change":"2024-04-15T23:38:36.904398+0000","last_active":"2024-04-15T23:38:36.904358+0000","last_peered":"2024-04-15T23:38:36.904358+0000","last_clean":"2024-04-15T23:38:36.904358+0000","last_became_active":"2024-04-15T23:37:54.972412+0000","last_became_peered":"2024-04-15T23:37:54.972412+0000","last_unstale":"2024-04-15T23:38:36.904358+0000","last_undegraded":"2024-04-15T23:38:36.904358+0000","last_fullsized":"2024-04-15T23:38:36.904358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'9","last_scrub_stamp":"2024-04-15T23:38:36.904275+0000","last_deep_scrub":"79'9","last_deep_scrub_stamp":"2024-04-15T23:38:36.904275+0000","last_clean_scrub_stamp":"2024-04-15T23:38:36.904275+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:44:00.249030+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"79'238","reported_seq":631,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.193816+0000","last_change":"2024-04-15T23:38:17.193855+0000","last_active":"2024-04-15T23:38:17.193816+0000","last_peered":"2024-04-15T23:38:17.193816+0000","last_clean":"2024-04-15T23:38:17.193816+0000","last_became_active":"2024-04-15T23:37:54.972459+0000","last_became_peered":"2024-04-15T23:37:54.972459+0000","last_unstale":"2024-04-15T23:38:17.193816+0000","last_undegraded":"2024-04-15T23:38:17.193816+0000","last_fullsized":"2024-04-15T23:38:17.193816+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'238","last_scrub_stamp":"2024-04-15T23:38:17.193722+0000","last_deep_scrub":"79'238","last_deep_scrub_stamp":"2024-04-15T23:38:17.193722+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.193722+0000","objects_scrubbed":58,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:28:26.910291+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91970,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.209663+0000","last_change":"2024-04-15T23:38:24.209687+0000","last_active":"2024-04-15T23:38:24.209663+0000","last_peered":"2024-04-15T23:38:24.209663+0000","last_clean":"2024-04-15T23:38:24.209663+0000","last_became_active":"2024-04-15T23:37:54.974152+0000","last_became_peered":"2024-04-15T23:37:54.974152+0000","last_unstale":"2024-04-15T23:38:24.209663+0000","last_undegraded":"2024-04-15T23:38:24.209663+0000","last_fullsized":"2024-04-15T23:38:24.209663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:24.209573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:24.209573+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.209573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:57:42.293988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"79'224","reported_seq":346,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:45.157071+0000","last_change":"2024-04-15T23:38:45.157103+0000","last_active":"2024-04-15T23:38:45.157071+0000","last_peered":"2024-04-15T23:38:45.157071+0000","last_clean":"2024-04-15T23:38:45.157071+0000","last_became_active":"2024-04-15T23:37:54.978234+0000","last_became_peered":"2024-04-15T23:37:54.978234+0000","last_unstale":"2024-04-15T23:38:45.157071+0000","last_undegraded":"2024-04-15T23:38:45.157071+0000","last_fullsized":"2024-04-15T23:38:45.157071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'224","last_scrub_stamp":"2024-04-15T23:38:45.156993+0000","last_deep_scrub":"79'224","last_deep_scrub_stamp":"2024-04-15T23:38:45.156993+0000","last_clean_scrub_stamp":"2024-04-15T23:38:45.156993+0000","objects_scrubbed":58,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:48:07.359784+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301592,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":161,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.487326+0000","last_change":"2024-04-15T23:38:11.487368+0000","last_active":"2024-04-15T23:38:11.487326+0000","last_peered":"2024-04-15T23:38:11.487326+0000","last_clean":"2024-04-15T23:38:11.487326+0000","last_became_active":"2024-04-15T23:37:54.975040+0000","last_became_peered":"2024-04-15T23:37:54.975040+0000","last_unstale":"2024-04-15T23:38:11.487326+0000","last_undegraded":"2024-04-15T23:38:11.487326+0000","last_fullsized":"2024-04-15T23:38:11.487326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:11.487224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:11.487224+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.487224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:54:24.474774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"79'191","reported_seq":312,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:14.213138+0000","last_change":"2024-04-15T23:38:14.213167+0000","last_active":"2024-04-15T23:38:14.213138+0000","last_peered":"2024-04-15T23:38:14.213138+0000","last_clean":"2024-04-15T23:38:14.213138+0000","last_became_active":"2024-04-15T23:37:54.977931+0000","last_became_peered":"2024-04-15T23:37:54.977931+0000","last_unstale":"2024-04-15T23:38:14.213138+0000","last_undegraded":"2024-04-15T23:38:14.213138+0000","last_fullsized":"2024-04-15T23:38:14.213138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'191","last_scrub_stamp":"2024-04-15T23:38:14.213023+0000","last_deep_scrub":"79'191","last_deep_scrub_stamp":"2024-04-15T23:38:14.213023+0000","last_clean_scrub_stamp":"2024-04-15T23:38:14.213023+0000","objects_scrubbed":53,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:01:47.573046+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3702682,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":3752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"48'1","reported_seq":162,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:29.662894+0000","last_change":"2024-04-15T23:38:29.662927+0000","last_active":"2024-04-15T23:38:29.662894+0000","last_peered":"2024-04-15T23:38:29.662894+0000","last_clean":"2024-04-15T23:38:29.662894+0000","last_became_active":"2024-04-15T23:35:07.908586+0000","last_became_peered":"2024-04-15T23:35:07.908586+0000","last_unstale":"2024-04-15T23:38:29.662894+0000","last_undegraded":"2024-04-15T23:38:29.662894+0000","last_fullsized":"2024-04-15T23:38:29.662894+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-15T23:38:29.662807+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-15T23:38:29.662807+0000","last_clean_scrub_stamp":"2024-04-15T23:38:29.662807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:44:07.870480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"79'192","reported_seq":316,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:17.956276+0000","last_change":"2024-04-15T23:38:17.956327+0000","last_active":"2024-04-15T23:38:17.956276+0000","last_peered":"2024-04-15T23:38:17.956276+0000","last_clean":"2024-04-15T23:38:17.956276+0000","last_became_active":"2024-04-15T23:35:13.299109+0000","last_became_peered":"2024-04-15T23:35:13.299109+0000","last_unstale":"2024-04-15T23:38:17.956276+0000","last_undegraded":"2024-04-15T23:38:17.956276+0000","last_fullsized":"2024-04-15T23:38:17.956276+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'192","last_scrub_stamp":"2024-04-15T23:38:17.956191+0000","last_deep_scrub":"79'192","last_deep_scrub_stamp":"2024-04-15T23:38:17.956191+0000","last_clean_scrub_stamp":"2024-04-15T23:38:17.956191+0000","objects_scrubbed":47,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:08:43.386809+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":565242,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":565230,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"79'159","reported_seq":324,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:15.150976+0000","last_change":"2024-04-15T23:38:15.151005+0000","last_active":"2024-04-15T23:38:15.150976+0000","last_peered":"2024-04-15T23:38:15.150976+0000","last_clean":"2024-04-15T23:38:15.150976+0000","last_became_active":"2024-04-15T23:37:54.979230+0000","last_became_peered":"2024-04-15T23:37:54.979230+0000","last_unstale":"2024-04-15T23:38:15.150976+0000","last_undegraded":"2024-04-15T23:38:15.150976+0000","last_fullsized":"2024-04-15T23:38:15.150976+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'159","last_scrub_stamp":"2024-04-15T23:38:15.150888+0000","last_deep_scrub":"79'159","last_deep_scrub_stamp":"2024-04-15T23:38:15.150888+0000","last_clean_scrub_stamp":"2024-04-15T23:38:15.150888+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:50:53.833085+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.162983+0000","last_change":"2024-04-15T23:38:21.163009+0000","last_active":"2024-04-15T23:38:21.162983+0000","last_peered":"2024-04-15T23:38:21.162983+0000","last_clean":"2024-04-15T23:38:21.162983+0000","last_became_active":"2024-04-15T23:37:54.974729+0000","last_became_peered":"2024-04-15T23:37:54.974729+0000","last_unstale":"2024-04-15T23:38:21.162983+0000","last_undegraded":"2024-04-15T23:38:21.162983+0000","last_fullsized":"2024-04-15T23:38:21.162983+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:21.162886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:21.162886+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.162886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:32:05.257000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"46'1","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:33.904806+0000","last_change":"2024-04-15T23:38:33.904873+0000","last_active":"2024-04-15T23:38:33.904806+0000","last_peered":"2024-04-15T23:38:33.904806+0000","last_clean":"2024-04-15T23:38:33.904806+0000","last_became_active":"2024-04-15T23:35:07.910372+0000","last_became_peered":"2024-04-15T23:35:07.910372+0000","last_unstale":"2024-04-15T23:38:33.904806+0000","last_undegraded":"2024-04-15T23:38:33.904806+0000","last_fullsized":"2024-04-15T23:38:33.904806+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'1","last_scrub_stamp":"2024-04-15T23:38:33.904691+0000","last_deep_scrub":"46'1","last_deep_scrub_stamp":"2024-04-15T23:38:33.904691+0000","last_clean_scrub_stamp":"2024-04-15T23:38:33.904691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:24:36.293883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"79'207","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:46.178599+0000","last_change":"2024-04-15T23:38:46.178629+0000","last_active":"2024-04-15T23:38:46.178599+0000","last_peered":"2024-04-15T23:38:46.178599+0000","last_clean":"2024-04-15T23:38:46.178599+0000","last_became_active":"2024-04-15T23:37:54.979436+0000","last_became_peered":"2024-04-15T23:37:54.979436+0000","last_unstale":"2024-04-15T23:38:46.178599+0000","last_undegraded":"2024-04-15T23:38:46.178599+0000","last_fullsized":"2024-04-15T23:38:46.178599+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'207","last_scrub_stamp":"2024-04-15T23:38:46.178523+0000","last_deep_scrub":"79'207","last_deep_scrub_stamp":"2024-04-15T23:38:46.178523+0000","last_clean_scrub_stamp":"2024-04-15T23:38:46.178523+0000","objects_scrubbed":56,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:16:53.748926+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":238891,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.201845+0000","last_change":"2024-04-15T23:38:11.201867+0000","last_active":"2024-04-15T23:38:11.201845+0000","last_peered":"2024-04-15T23:38:11.201845+0000","last_clean":"2024-04-15T23:38:11.201845+0000","last_became_active":"2024-04-15T23:37:54.978764+0000","last_became_peered":"2024-04-15T23:37:54.978764+0000","last_unstale":"2024-04-15T23:38:11.201845+0000","last_undegraded":"2024-04-15T23:38:11.201845+0000","last_fullsized":"2024-04-15T23:38:11.201845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:11.201750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:11.201750+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.201750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:38:43.306147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"79'36","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.930002+0000","last_change":"2024-04-15T23:38:18.930031+0000","last_active":"2024-04-15T23:38:18.930002+0000","last_peered":"2024-04-15T23:38:18.930002+0000","last_clean":"2024-04-15T23:38:18.930002+0000","last_became_active":"2024-04-15T23:37:54.968778+0000","last_became_peered":"2024-04-15T23:37:54.968778+0000","last_unstale":"2024-04-15T23:38:18.930002+0000","last_undegraded":"2024-04-15T23:38:18.930002+0000","last_fullsized":"2024-04-15T23:38:18.930002+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'36","last_scrub_stamp":"2024-04-15T23:38:18.929917+0000","last_deep_scrub":"79'36","last_deep_scrub_stamp":"2024-04-15T23:38:18.929917+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.929917+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-16T23:48:20.198030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327644,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":34,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":327644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"79'216","reported_seq":589,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:19.599326+0000","last_change":"2024-04-15T23:38:19.599364+0000","last_active":"2024-04-15T23:38:19.599326+0000","last_peered":"2024-04-15T23:38:19.599326+0000","last_clean":"2024-04-15T23:38:19.599326+0000","last_became_active":"2024-04-15T23:35:15.300239+0000","last_became_peered":"2024-04-15T23:35:15.300239+0000","last_unstale":"2024-04-15T23:38:19.599326+0000","last_undegraded":"2024-04-15T23:38:19.599326+0000","last_fullsized":"2024-04-15T23:38:19.599326+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'216","last_scrub_stamp":"2024-04-15T23:38:19.599234+0000","last_deep_scrub":"79'216","last_deep_scrub_stamp":"2024-04-15T23:38:19.599234+0000","last_clean_scrub_stamp":"2024-04-15T23:38:19.599234+0000","objects_scrubbed":57,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:56:14.976800+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":246252,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":179,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":238754,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:30.820966+0000","last_change":"2024-04-15T23:38:30.821014+0000","last_active":"2024-04-15T23:38:30.820966+0000","last_peered":"2024-04-15T23:38:30.820966+0000","last_clean":"2024-04-15T23:38:30.820966+0000","last_became_active":"2024-04-15T23:35:07.907964+0000","last_became_peered":"2024-04-15T23:35:07.907964+0000","last_unstale":"2024-04-15T23:38:30.820966+0000","last_undegraded":"2024-04-15T23:38:30.820966+0000","last_fullsized":"2024-04-15T23:38:30.820966+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:30.820871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:30.820871+0000","last_clean_scrub_stamp":"2024-04-15T23:38:30.820871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:15:14.806089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"79'57","reported_seq":218,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:22.546341+0000","last_change":"2024-04-15T23:38:22.546399+0000","last_active":"2024-04-15T23:38:22.546341+0000","last_peered":"2024-04-15T23:38:22.546341+0000","last_clean":"2024-04-15T23:38:22.546341+0000","last_became_active":"2024-04-15T23:37:54.983358+0000","last_became_peered":"2024-04-15T23:37:54.983358+0000","last_unstale":"2024-04-15T23:38:22.546341+0000","last_undegraded":"2024-04-15T23:38:22.546341+0000","last_fullsized":"2024-04-15T23:38:22.546341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'57","last_scrub_stamp":"2024-04-15T23:38:22.546216+0000","last_deep_scrub":"79'57","last_deep_scrub_stamp":"2024-04-15T23:38:22.546216+0000","last_clean_scrub_stamp":"2024-04-15T23:38:22.546216+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:55:52.662990+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"79'221","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:21.873315+0000","last_change":"2024-04-15T23:38:21.873345+0000","last_active":"2024-04-15T23:38:21.873315+0000","last_peered":"2024-04-15T23:38:21.873315+0000","last_clean":"2024-04-15T23:38:21.873315+0000","last_became_active":"2024-04-15T23:35:12.300699+0000","last_became_peered":"2024-04-15T23:35:12.300699+0000","last_unstale":"2024-04-15T23:38:21.873315+0000","last_undegraded":"2024-04-15T23:38:21.873315+0000","last_fullsized":"2024-04-15T23:38:21.873315+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'221","last_scrub_stamp":"2024-04-15T23:38:21.873225+0000","last_deep_scrub":"79'221","last_deep_scrub_stamp":"2024-04-15T23:38:21.873225+0000","last_clean_scrub_stamp":"2024-04-15T23:38:21.873225+0000","objects_scrubbed":57,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:07:35.908985+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209098,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":108,"num_bytes_recovered":209089,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.169337+0000","last_change":"2024-04-15T23:38:20.169363+0000","last_active":"2024-04-15T23:38:20.169337+0000","last_peered":"2024-04-15T23:38:20.169337+0000","last_clean":"2024-04-15T23:38:20.169337+0000","last_became_active":"2024-04-15T23:37:54.974496+0000","last_became_peered":"2024-04-15T23:37:54.974496+0000","last_unstale":"2024-04-15T23:38:20.169337+0000","last_undegraded":"2024-04-15T23:38:20.169337+0000","last_fullsized":"2024-04-15T23:38:20.169337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:20.169233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:20.169233+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.169233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:18:09.381116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.211257+0000","last_change":"2024-04-15T23:38:23.211296+0000","last_active":"2024-04-15T23:38:23.211257+0000","last_peered":"2024-04-15T23:38:23.211257+0000","last_clean":"2024-04-15T23:38:23.211257+0000","last_became_active":"2024-04-15T23:37:54.975241+0000","last_became_peered":"2024-04-15T23:37:54.975241+0000","last_unstale":"2024-04-15T23:38:23.211257+0000","last_undegraded":"2024-04-15T23:38:23.211257+0000","last_fullsized":"2024-04-15T23:38:23.211257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:23.211170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:23.211170+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.211170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T01:36:30.223970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"79'211","reported_seq":334,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:13.907948+0000","last_change":"2024-04-15T23:38:13.907976+0000","last_active":"2024-04-15T23:38:13.907948+0000","last_peered":"2024-04-15T23:38:13.907948+0000","last_clean":"2024-04-15T23:38:13.907948+0000","last_became_active":"2024-04-15T23:35:14.299723+0000","last_became_peered":"2024-04-15T23:35:14.299723+0000","last_unstale":"2024-04-15T23:38:13.907948+0000","last_undegraded":"2024-04-15T23:38:13.907948+0000","last_fullsized":"2024-04-15T23:38:13.907948+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'211","last_scrub_stamp":"2024-04-15T23:38:13.907868+0000","last_deep_scrub":"79'211","last_deep_scrub_stamp":"2024-04-15T23:38:13.907868+0000","last_clean_scrub_stamp":"2024-04-15T23:38:13.907868+0000","objects_scrubbed":54,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:04:37.554420+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117552,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":117552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:39.135139+0000","last_change":"2024-04-15T23:38:39.135163+0000","last_active":"2024-04-15T23:38:39.135139+0000","last_peered":"2024-04-15T23:38:39.135139+0000","last_clean":"2024-04-15T23:38:39.135139+0000","last_became_active":"2024-04-15T23:37:54.973182+0000","last_became_peered":"2024-04-15T23:37:54.973182+0000","last_unstale":"2024-04-15T23:38:39.135139+0000","last_undegraded":"2024-04-15T23:38:39.135139+0000","last_fullsized":"2024-04-15T23:38:39.135139+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:39.135017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:39.135017+0000","last_clean_scrub_stamp":"2024-04-15T23:38:39.135017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:08:04.771550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:29.783610+0000","last_change":"2024-04-15T23:38:29.783645+0000","last_active":"2024-04-15T23:38:29.783610+0000","last_peered":"2024-04-15T23:38:29.783610+0000","last_clean":"2024-04-15T23:38:29.783610+0000","last_became_active":"2024-04-15T23:35:07.907845+0000","last_became_peered":"2024-04-15T23:35:07.907845+0000","last_unstale":"2024-04-15T23:38:29.783610+0000","last_undegraded":"2024-04-15T23:38:29.783610+0000","last_fullsized":"2024-04-15T23:38:29.783610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:29.783477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:29.783477+0000","last_clean_scrub_stamp":"2024-04-15T23:38:29.783477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:27:38.280758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"79'257","reported_seq":417,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:39.725481+0000","last_change":"2024-04-15T23:38:39.725535+0000","last_active":"2024-04-15T23:38:39.725481+0000","last_peered":"2024-04-15T23:38:39.725481+0000","last_clean":"2024-04-15T23:38:39.725481+0000","last_became_active":"2024-04-15T23:37:54.978858+0000","last_became_peered":"2024-04-15T23:37:54.978858+0000","last_unstale":"2024-04-15T23:38:39.725481+0000","last_undegraded":"2024-04-15T23:38:39.725481+0000","last_fullsized":"2024-04-15T23:38:39.725481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'257","last_scrub_stamp":"2024-04-15T23:38:39.725403+0000","last_deep_scrub":"79'257","last_deep_scrub_stamp":"2024-04-15T23:38:39.725403+0000","last_clean_scrub_stamp":"2024-04-15T23:38:39.725403+0000","objects_scrubbed":46,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:10:58.026569+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61402,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"46'1","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:31.863123+0000","last_change":"2024-04-15T23:38:31.863146+0000","last_active":"2024-04-15T23:38:31.863123+0000","last_peered":"2024-04-15T23:38:31.863123+0000","last_clean":"2024-04-15T23:38:31.863123+0000","last_became_active":"2024-04-15T23:35:07.908464+0000","last_became_peered":"2024-04-15T23:35:07.908464+0000","last_unstale":"2024-04-15T23:38:31.863123+0000","last_undegraded":"2024-04-15T23:38:31.863123+0000","last_fullsized":"2024-04-15T23:38:31.863123+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'1","last_scrub_stamp":"2024-04-15T23:38:31.863024+0000","last_deep_scrub":"46'1","last_deep_scrub_stamp":"2024-04-15T23:38:31.863024+0000","last_clean_scrub_stamp":"2024-04-15T23:38:31.863024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:05:10.267833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.614971+0000","last_change":"2024-04-15T23:38:28.615047+0000","last_active":"2024-04-15T23:38:28.614971+0000","last_peered":"2024-04-15T23:38:28.614971+0000","last_clean":"2024-04-15T23:38:28.614971+0000","last_became_active":"2024-04-15T23:35:07.906232+0000","last_became_peered":"2024-04-15T23:35:07.906232+0000","last_unstale":"2024-04-15T23:38:28.614971+0000","last_undegraded":"2024-04-15T23:38:28.614971+0000","last_fullsized":"2024-04-15T23:38:28.614971+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:28.614855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:28.614855+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.614855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:04:30.732928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"79'233","reported_seq":394,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.607055+0000","last_change":"2024-04-15T23:38:26.607087+0000","last_active":"2024-04-15T23:38:26.607055+0000","last_peered":"2024-04-15T23:38:26.607055+0000","last_clean":"2024-04-15T23:38:26.607055+0000","last_became_active":"2024-04-15T23:37:54.979736+0000","last_became_peered":"2024-04-15T23:37:54.979736+0000","last_unstale":"2024-04-15T23:38:26.607055+0000","last_undegraded":"2024-04-15T23:38:26.607055+0000","last_fullsized":"2024-04-15T23:38:26.607055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'233","last_scrub_stamp":"2024-04-15T23:38:26.606966+0000","last_deep_scrub":"79'233","last_deep_scrub_stamp":"2024-04-15T23:38:26.606966+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.606966+0000","objects_scrubbed":53,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:20:39.151099+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":526528,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"79'3","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:34.934974+0000","last_change":"2024-04-15T23:38:34.935013+0000","last_active":"2024-04-15T23:38:34.934974+0000","last_peered":"2024-04-15T23:38:34.934974+0000","last_clean":"2024-04-15T23:38:34.934974+0000","last_became_active":"2024-04-15T23:35:07.910376+0000","last_became_peered":"2024-04-15T23:35:07.910376+0000","last_unstale":"2024-04-15T23:38:34.934974+0000","last_undegraded":"2024-04-15T23:38:34.934974+0000","last_fullsized":"2024-04-15T23:38:34.934974+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:34.934893+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:34.934893+0000","last_clean_scrub_stamp":"2024-04-15T23:38:34.934893+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:41:51.330998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:32.898694+0000","last_change":"2024-04-15T23:38:32.898719+0000","last_active":"2024-04-15T23:38:32.898694+0000","last_peered":"2024-04-15T23:38:32.898694+0000","last_clean":"2024-04-15T23:38:32.898694+0000","last_became_active":"2024-04-15T23:35:07.908820+0000","last_became_peered":"2024-04-15T23:35:07.908820+0000","last_unstale":"2024-04-15T23:38:32.898694+0000","last_undegraded":"2024-04-15T23:38:32.898694+0000","last_fullsized":"2024-04-15T23:38:32.898694+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:32.898600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:32.898600+0000","last_clean_scrub_stamp":"2024-04-15T23:38:32.898600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:46:21.574949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"79'215","reported_seq":348,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:42.846155+0000","last_change":"2024-04-15T23:38:42.846155+0000","last_active":"2024-04-15T23:38:42.846155+0000","last_peered":"2024-04-15T23:38:42.846155+0000","last_clean":"2024-04-15T23:38:42.846155+0000","last_became_active":"2024-04-15T23:37:54.978884+0000","last_became_peered":"2024-04-15T23:37:54.978884+0000","last_unstale":"2024-04-15T23:38:42.846155+0000","last_undegraded":"2024-04-15T23:38:42.846155+0000","last_fullsized":"2024-04-15T23:38:42.846155+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'215","last_scrub_stamp":"2024-04-15T23:38:42.846025+0000","last_deep_scrub":"79'215","last_deep_scrub_stamp":"2024-04-15T23:38:42.846025+0000","last_clean_scrub_stamp":"2024-04-15T23:38:42.846025+0000","objects_scrubbed":60,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:04:29.397205+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333066,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":333038,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"79'37","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:16.920225+0000","last_change":"2024-04-15T23:38:16.920251+0000","last_active":"2024-04-15T23:38:16.920225+0000","last_peered":"2024-04-15T23:38:16.920225+0000","last_clean":"2024-04-15T23:38:16.920225+0000","last_became_active":"2024-04-15T23:37:54.968665+0000","last_became_peered":"2024-04-15T23:37:54.968665+0000","last_unstale":"2024-04-15T23:38:16.920225+0000","last_undegraded":"2024-04-15T23:38:16.920225+0000","last_fullsized":"2024-04-15T23:38:16.920225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'37","last_scrub_stamp":"2024-04-15T23:38:16.920141+0000","last_deep_scrub":"79'37","last_deep_scrub_stamp":"2024-04-15T23:38:16.920141+0000","last_clean_scrub_stamp":"2024-04-15T23:38:16.920141+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:05:28.389525+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:27.224776+0000","last_change":"2024-04-15T23:38:27.224802+0000","last_active":"2024-04-15T23:38:27.224776+0000","last_peered":"2024-04-15T23:38:27.224776+0000","last_clean":"2024-04-15T23:38:27.224776+0000","last_became_active":"2024-04-15T23:37:54.977209+0000","last_became_peered":"2024-04-15T23:37:54.977209+0000","last_unstale":"2024-04-15T23:38:27.224776+0000","last_undegraded":"2024-04-15T23:38:27.224776+0000","last_fullsized":"2024-04-15T23:38:27.224776+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:27.224626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:27.224626+0000","last_clean_scrub_stamp":"2024-04-15T23:38:27.224626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:23:02.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"79'191","reported_seq":351,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:24.584056+0000","last_change":"2024-04-15T23:38:24.584113+0000","last_active":"2024-04-15T23:38:24.584056+0000","last_peered":"2024-04-15T23:38:24.584056+0000","last_clean":"2024-04-15T23:38:24.584056+0000","last_became_active":"2024-04-15T23:37:54.982823+0000","last_became_peered":"2024-04-15T23:37:54.982823+0000","last_unstale":"2024-04-15T23:38:24.584056+0000","last_undegraded":"2024-04-15T23:38:24.584056+0000","last_fullsized":"2024-04-15T23:38:24.584056+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'191","last_scrub_stamp":"2024-04-15T23:38:24.583969+0000","last_deep_scrub":"79'191","last_deep_scrub_stamp":"2024-04-15T23:38:24.583969+0000","last_clean_scrub_stamp":"2024-04-15T23:38:24.583969+0000","objects_scrubbed":49,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:30:23.632335+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":648470,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"79'221","reported_seq":338,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:42.169368+0000","last_change":"2024-04-15T23:38:42.169430+0000","last_active":"2024-04-15T23:38:42.169368+0000","last_peered":"2024-04-15T23:38:42.169368+0000","last_clean":"2024-04-15T23:38:42.169368+0000","last_became_active":"2024-04-15T23:37:54.977101+0000","last_became_peered":"2024-04-15T23:37:54.977101+0000","last_unstale":"2024-04-15T23:38:42.169368+0000","last_undegraded":"2024-04-15T23:38:42.169368+0000","last_fullsized":"2024-04-15T23:38:42.169368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'221","last_scrub_stamp":"2024-04-15T23:38:42.169283+0000","last_deep_scrub":"79'221","last_deep_scrub_stamp":"2024-04-15T23:38:42.169283+0000","last_clean_scrub_stamp":"2024-04-15T23:38:42.169283+0000","objects_scrubbed":66,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:47:31.569696+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115625,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"79'47","reported_seq":176,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:29.161814+0000","last_change":"2024-04-15T23:38:29.161849+0000","last_active":"2024-04-15T23:38:29.161814+0000","last_peered":"2024-04-15T23:38:29.161814+0000","last_clean":"2024-04-15T23:38:29.161814+0000","last_became_active":"2024-04-15T23:37:54.977412+0000","last_became_peered":"2024-04-15T23:37:54.977412+0000","last_unstale":"2024-04-15T23:38:29.161814+0000","last_undegraded":"2024-04-15T23:38:29.161814+0000","last_fullsized":"2024-04-15T23:38:29.161814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'47","last_scrub_stamp":"2024-04-15T23:38:29.161727+0000","last_deep_scrub":"79'47","last_deep_scrub_stamp":"2024-04-15T23:38:29.161727+0000","last_clean_scrub_stamp":"2024-04-15T23:38:29.161727+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:52:36.405857+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"79'202","reported_seq":329,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:23.847512+0000","last_change":"2024-04-15T23:38:23.847575+0000","last_active":"2024-04-15T23:38:23.847512+0000","last_peered":"2024-04-15T23:38:23.847512+0000","last_clean":"2024-04-15T23:38:23.847512+0000","last_became_active":"2024-04-15T23:35:12.300557+0000","last_became_peered":"2024-04-15T23:35:12.300557+0000","last_unstale":"2024-04-15T23:38:23.847512+0000","last_undegraded":"2024-04-15T23:38:23.847512+0000","last_fullsized":"2024-04-15T23:38:23.847512+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'202","last_scrub_stamp":"2024-04-15T23:38:23.847415+0000","last_deep_scrub":"79'202","last_deep_scrub_stamp":"2024-04-15T23:38:23.847415+0000","last_clean_scrub_stamp":"2024-04-15T23:38:23.847415+0000","objects_scrubbed":55,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:00:40.815243+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196150,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":196150,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"79'25","reported_seq":186,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:43.781927+0000","last_change":"2024-04-15T23:38:43.781927+0000","last_active":"2024-04-15T23:38:43.781927+0000","last_peered":"2024-04-15T23:38:43.781927+0000","last_clean":"2024-04-15T23:38:43.781927+0000","last_became_active":"2024-04-15T23:37:54.985163+0000","last_became_peered":"2024-04-15T23:37:54.985163+0000","last_unstale":"2024-04-15T23:38:43.781927+0000","last_undegraded":"2024-04-15T23:38:43.781927+0000","last_fullsized":"2024-04-15T23:38:43.781927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'25","last_scrub_stamp":"2024-04-15T23:38:43.781795+0000","last_deep_scrub":"79'25","last_deep_scrub_stamp":"2024-04-15T23:38:43.781795+0000","last_clean_scrub_stamp":"2024-04-15T23:38:43.781795+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:18:55.811032+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":143,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:33.229948+0000","last_change":"2024-04-15T23:38:33.229974+0000","last_active":"2024-04-15T23:38:33.229948+0000","last_peered":"2024-04-15T23:38:33.229948+0000","last_clean":"2024-04-15T23:38:33.229948+0000","last_became_active":"2024-04-15T23:37:54.966733+0000","last_became_peered":"2024-04-15T23:37:54.966733+0000","last_unstale":"2024-04-15T23:38:33.229948+0000","last_undegraded":"2024-04-15T23:38:33.229948+0000","last_fullsized":"2024-04-15T23:38:33.229948+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:33.229860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:33.229860+0000","last_clean_scrub_stamp":"2024-04-15T23:38:33.229860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:27:43.220323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"79'236","reported_seq":374,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:41.895672+0000","last_change":"2024-04-15T23:38:41.895732+0000","last_active":"2024-04-15T23:38:41.895672+0000","last_peered":"2024-04-15T23:38:41.895672+0000","last_clean":"2024-04-15T23:38:41.895672+0000","last_became_active":"2024-04-15T23:37:54.973778+0000","last_became_peered":"2024-04-15T23:37:54.973778+0000","last_unstale":"2024-04-15T23:38:41.895672+0000","last_undegraded":"2024-04-15T23:38:41.895672+0000","last_fullsized":"2024-04-15T23:38:41.895672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'236","last_scrub_stamp":"2024-04-15T23:38:41.895550+0000","last_deep_scrub":"79'236","last_deep_scrub_stamp":"2024-04-15T23:38:41.895550+0000","last_clean_scrub_stamp":"2024-04-15T23:38:41.895550+0000","objects_scrubbed":64,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:42:21.468655+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132020,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":167,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":114,"num_bytes_recovered":132020,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"44'1","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:11.911580+0000","last_change":"2024-04-15T23:38:11.911623+0000","last_active":"2024-04-15T23:38:11.911580+0000","last_peered":"2024-04-15T23:38:11.911580+0000","last_clean":"2024-04-15T23:38:11.911580+0000","last_became_active":"2024-04-15T23:37:54.972805+0000","last_became_peered":"2024-04-15T23:37:54.972805+0000","last_unstale":"2024-04-15T23:38:11.911580+0000","last_undegraded":"2024-04-15T23:38:11.911580+0000","last_fullsized":"2024-04-15T23:38:11.911580+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'1","last_scrub_stamp":"2024-04-15T23:38:11.911437+0000","last_deep_scrub":"44'1","last_deep_scrub_stamp":"2024-04-15T23:38:11.911437+0000","last_clean_scrub_stamp":"2024-04-15T23:38:11.911437+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T10:15:07.652712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"79'209","reported_seq":340,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:25.805793+0000","last_change":"2024-04-15T23:38:25.805819+0000","last_active":"2024-04-15T23:38:25.805793+0000","last_peered":"2024-04-15T23:38:25.805793+0000","last_clean":"2024-04-15T23:38:25.805793+0000","last_became_active":"2024-04-15T23:35:10.301822+0000","last_became_peered":"2024-04-15T23:35:10.301822+0000","last_unstale":"2024-04-15T23:38:25.805793+0000","last_undegraded":"2024-04-15T23:38:25.805793+0000","last_fullsized":"2024-04-15T23:38:25.805793+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'209","last_scrub_stamp":"2024-04-15T23:38:25.805715+0000","last_deep_scrub":"79'209","last_deep_scrub_stamp":"2024-04-15T23:38:25.805715+0000","last_clean_scrub_stamp":"2024-04-15T23:38:25.805715+0000","objects_scrubbed":50,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:04:19.023092+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68437,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":68437,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"79'224","reported_seq":385,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:38.696656+0000","last_change":"2024-04-15T23:38:38.696683+0000","last_active":"2024-04-15T23:38:38.696656+0000","last_peered":"2024-04-15T23:38:38.696656+0000","last_clean":"2024-04-15T23:38:38.696656+0000","last_became_active":"2024-04-15T23:37:54.983430+0000","last_became_peered":"2024-04-15T23:37:54.983430+0000","last_unstale":"2024-04-15T23:38:38.696656+0000","last_undegraded":"2024-04-15T23:38:38.696656+0000","last_fullsized":"2024-04-15T23:38:38.696656+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'224","last_scrub_stamp":"2024-04-15T23:38:38.696579+0000","last_deep_scrub":"79'224","last_deep_scrub_stamp":"2024-04-15T23:38:38.696579+0000","last_clean_scrub_stamp":"2024-04-15T23:38:38.696579+0000","objects_scrubbed":53,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:37:33.027964+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195697,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"48'1","reported_seq":70,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:28.746736+0000","last_change":"2024-04-15T23:38:28.746758+0000","last_active":"2024-04-15T23:38:28.746736+0000","last_peered":"2024-04-15T23:38:28.746736+0000","last_clean":"2024-04-15T23:38:28.746736+0000","last_became_active":"2024-04-15T23:35:07.907052+0000","last_became_peered":"2024-04-15T23:35:07.907052+0000","last_unstale":"2024-04-15T23:38:28.746736+0000","last_undegraded":"2024-04-15T23:38:28.746736+0000","last_fullsized":"2024-04-15T23:38:28.746736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1","last_scrub_stamp":"2024-04-15T23:38:28.746647+0000","last_deep_scrub":"48'1","last_deep_scrub_stamp":"2024-04-15T23:38:28.746647+0000","last_clean_scrub_stamp":"2024-04-15T23:38:28.746647+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:00:25.774524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"79'204","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:37.906615+0000","last_change":"2024-04-15T23:38:37.906615+0000","last_active":"2024-04-15T23:38:37.906615+0000","last_peered":"2024-04-15T23:38:37.906615+0000","last_clean":"2024-04-15T23:38:37.906615+0000","last_became_active":"2024-04-15T23:37:54.971949+0000","last_became_peered":"2024-04-15T23:37:54.971949+0000","last_unstale":"2024-04-15T23:38:37.906615+0000","last_undegraded":"2024-04-15T23:38:37.906615+0000","last_fullsized":"2024-04-15T23:38:37.906615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'204","last_scrub_stamp":"2024-04-15T23:38:37.906406+0000","last_deep_scrub":"79'204","last_deep_scrub_stamp":"2024-04-15T23:38:37.906406+0000","last_clean_scrub_stamp":"2024-04-15T23:38:37.906406+0000","objects_scrubbed":47,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:28:14.525460+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109171,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":166,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":103468,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:20.873570+0000","last_change":"2024-04-15T23:38:20.873620+0000","last_active":"2024-04-15T23:38:20.873570+0000","last_peered":"2024-04-15T23:38:20.873570+0000","last_clean":"2024-04-15T23:38:20.873570+0000","last_became_active":"2024-04-15T23:37:54.968945+0000","last_became_peered":"2024-04-15T23:37:54.968945+0000","last_unstale":"2024-04-15T23:38:20.873570+0000","last_undegraded":"2024-04-15T23:38:20.873570+0000","last_fullsized":"2024-04-15T23:38:20.873570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-15T23:38:20.873470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-15T23:38:20.873470+0000","last_clean_scrub_stamp":"2024-04-15T23:38:20.873470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:49:50.516057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"79'210","reported_seq":371,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:41.835412+0000","last_change":"2024-04-15T23:38:41.835412+0000","last_active":"2024-04-15T23:38:41.835412+0000","last_peered":"2024-04-15T23:38:41.835412+0000","last_clean":"2024-04-15T23:38:41.835412+0000","last_became_active":"2024-04-15T23:37:54.978952+0000","last_became_peered":"2024-04-15T23:37:54.978952+0000","last_unstale":"2024-04-15T23:38:41.835412+0000","last_undegraded":"2024-04-15T23:38:41.835412+0000","last_fullsized":"2024-04-15T23:38:41.835412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'210","last_scrub_stamp":"2024-04-15T23:38:41.835294+0000","last_deep_scrub":"79'210","last_deep_scrub_stamp":"2024-04-15T23:38:41.835294+0000","last_clean_scrub_stamp":"2024-04-15T23:38:41.835294+0000","objects_scrubbed":62,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:12:39.398581+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":559465,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"79'3","reported_seq":169,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:30.658212+0000","last_change":"2024-04-15T23:38:30.658212+0000","last_active":"2024-04-15T23:38:30.658212+0000","last_peered":"2024-04-15T23:38:30.658212+0000","last_clean":"2024-04-15T23:38:30.658212+0000","last_became_active":"2024-04-15T23:35:07.909347+0000","last_became_peered":"2024-04-15T23:35:07.909347+0000","last_unstale":"2024-04-15T23:38:30.658212+0000","last_undegraded":"2024-04-15T23:38:30.658212+0000","last_fullsized":"2024-04-15T23:38:30.658212+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:30.658093+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:30.658093+0000","last_clean_scrub_stamp":"2024-04-15T23:38:30.658093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T06:14:15.193263+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"79'220","reported_seq":593,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:35.721480+0000","last_change":"2024-04-15T23:38:35.721480+0000","last_active":"2024-04-15T23:38:35.721480+0000","last_peered":"2024-04-15T23:38:35.721480+0000","last_clean":"2024-04-15T23:38:35.721480+0000","last_became_active":"2024-04-15T23:35:13.298305+0000","last_became_peered":"2024-04-15T23:35:13.298305+0000","last_unstale":"2024-04-15T23:38:35.721480+0000","last_undegraded":"2024-04-15T23:38:35.721480+0000","last_fullsized":"2024-04-15T23:38:35.721480+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'220","last_scrub_stamp":"2024-04-15T23:38:35.721348+0000","last_deep_scrub":"79'220","last_deep_scrub_stamp":"2024-04-15T23:38:35.721348+0000","last_clean_scrub_stamp":"2024-04-15T23:38:35.721348+0000","objects_scrubbed":60,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T11:27:36.042951+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":485599,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":482938,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"79'6","reported_seq":167,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:18.527190+0000","last_change":"2024-04-15T23:38:18.527190+0000","last_active":"2024-04-15T23:38:18.527190+0000","last_peered":"2024-04-15T23:38:18.527190+0000","last_clean":"2024-04-15T23:38:18.527190+0000","last_became_active":"2024-04-15T23:37:54.983320+0000","last_became_peered":"2024-04-15T23:37:54.983320+0000","last_unstale":"2024-04-15T23:38:18.527190+0000","last_undegraded":"2024-04-15T23:38:18.527190+0000","last_fullsized":"2024-04-15T23:38:18.527190+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'6","last_scrub_stamp":"2024-04-15T23:38:18.527070+0000","last_deep_scrub":"79'6","last_deep_scrub_stamp":"2024-04-15T23:38:18.527070+0000","last_clean_scrub_stamp":"2024-04-15T23:38:18.527070+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T08:03:39.532930+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"79'213","reported_seq":578,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:30.225509+0000","last_change":"2024-04-15T23:38:30.225535+0000","last_active":"2024-04-15T23:38:30.225509+0000","last_peered":"2024-04-15T23:38:30.225509+0000","last_clean":"2024-04-15T23:38:30.225509+0000","last_became_active":"2024-04-15T23:37:54.971136+0000","last_became_peered":"2024-04-15T23:37:54.971136+0000","last_unstale":"2024-04-15T23:38:30.225509+0000","last_undegraded":"2024-04-15T23:38:30.225509+0000","last_fullsized":"2024-04-15T23:38:30.225509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'213","last_scrub_stamp":"2024-04-15T23:38:30.225427+0000","last_deep_scrub":"79'213","last_deep_scrub_stamp":"2024-04-15T23:38:30.225427+0000","last_clean_scrub_stamp":"2024-04-15T23:38:30.225427+0000","objects_scrubbed":50,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T07:09:05.333778+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111927,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"79'3","reported_seq":146,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:34.185084+0000","last_change":"2024-04-15T23:38:34.185112+0000","last_active":"2024-04-15T23:38:34.185084+0000","last_peered":"2024-04-15T23:38:34.185084+0000","last_clean":"2024-04-15T23:38:34.185084+0000","last_became_active":"2024-04-15T23:37:54.968094+0000","last_became_peered":"2024-04-15T23:37:54.968094+0000","last_unstale":"2024-04-15T23:38:34.185084+0000","last_undegraded":"2024-04-15T23:38:34.185084+0000","last_fullsized":"2024-04-15T23:38:34.185084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:34.184998+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:34.184998+0000","last_clean_scrub_stamp":"2024-04-15T23:38:34.184998+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T00:17:31.864353+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"79'212","reported_seq":571,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:38.201820+0000","last_change":"2024-04-15T23:38:38.201869+0000","last_active":"2024-04-15T23:38:38.201820+0000","last_peered":"2024-04-15T23:38:38.201820+0000","last_clean":"2024-04-15T23:38:38.201820+0000","last_became_active":"2024-04-15T23:37:54.969873+0000","last_became_peered":"2024-04-15T23:37:54.969873+0000","last_unstale":"2024-04-15T23:38:38.201820+0000","last_undegraded":"2024-04-15T23:38:38.201820+0000","last_fullsized":"2024-04-15T23:38:38.201820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'212","last_scrub_stamp":"2024-04-15T23:38:38.201716+0000","last_deep_scrub":"79'212","last_deep_scrub_stamp":"2024-04-15T23:38:38.201716+0000","last_clean_scrub_stamp":"2024-04-15T23:38:38.201716+0000","objects_scrubbed":53,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T09:25:46.988099+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173945,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"79'62","reported_seq":223,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:42.790950+0000","last_change":"2024-04-15T23:38:42.790950+0000","last_active":"2024-04-15T23:38:42.790950+0000","last_peered":"2024-04-15T23:38:42.790950+0000","last_clean":"2024-04-15T23:38:42.790950+0000","last_became_active":"2024-04-15T23:37:54.985155+0000","last_became_peered":"2024-04-15T23:37:54.985155+0000","last_unstale":"2024-04-15T23:38:42.790950+0000","last_undegraded":"2024-04-15T23:38:42.790950+0000","last_fullsized":"2024-04-15T23:38:42.790950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'62","last_scrub_stamp":"2024-04-15T23:38:42.790830+0000","last_deep_scrub":"79'62","last_deep_scrub_stamp":"2024-04-15T23:38:42.790830+0000","last_clean_scrub_stamp":"2024-04-15T23:38:42.790830+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T04:28:29.923687+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"79'226","reported_seq":603,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:32.692274+0000","last_change":"2024-04-15T23:38:32.692274+0000","last_active":"2024-04-15T23:38:32.692274+0000","last_peered":"2024-04-15T23:38:32.692274+0000","last_clean":"2024-04-15T23:38:32.692274+0000","last_became_active":"2024-04-15T23:35:11.294550+0000","last_became_peered":"2024-04-15T23:35:11.294550+0000","last_unstale":"2024-04-15T23:38:32.692274+0000","last_undegraded":"2024-04-15T23:38:32.692274+0000","last_fullsized":"2024-04-15T23:38:32.692274+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'226","last_scrub_stamp":"2024-04-15T23:38:32.692164+0000","last_deep_scrub":"79'226","last_deep_scrub_stamp":"2024-04-15T23:38:32.692164+0000","last_clean_scrub_stamp":"2024-04-15T23:38:32.692164+0000","objects_scrubbed":59,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:51:00.811729+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351041,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":348789,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'3","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:35.911066+0000","last_change":"2024-04-15T23:38:35.911066+0000","last_active":"2024-04-15T23:38:35.911066+0000","last_peered":"2024-04-15T23:38:35.911066+0000","last_clean":"2024-04-15T23:38:35.911066+0000","last_became_active":"2024-04-15T23:35:07.910486+0000","last_became_peered":"2024-04-15T23:35:07.910486+0000","last_unstale":"2024-04-15T23:38:35.911066+0000","last_undegraded":"2024-04-15T23:38:35.911066+0000","last_fullsized":"2024-04-15T23:38:35.911066+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'3","last_scrub_stamp":"2024-04-15T23:38:35.910906+0000","last_deep_scrub":"79'3","last_deep_scrub_stamp":"2024-04-15T23:38:35.910906+0000","last_clean_scrub_stamp":"2024-04-15T23:38:35.910906+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T02:46:53.970048+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"79'254","reported_seq":653,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:32.280644+0000","last_change":"2024-04-15T23:38:32.280678+0000","last_active":"2024-04-15T23:38:32.280644+0000","last_peered":"2024-04-15T23:38:32.280644+0000","last_clean":"2024-04-15T23:38:32.280644+0000","last_became_active":"2024-04-15T23:37:54.968951+0000","last_became_peered":"2024-04-15T23:37:54.968951+0000","last_unstale":"2024-04-15T23:38:32.280644+0000","last_undegraded":"2024-04-15T23:38:32.280644+0000","last_fullsized":"2024-04-15T23:38:32.280644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'254","last_scrub_stamp":"2024-04-15T23:38:32.280552+0000","last_deep_scrub":"79'254","last_deep_scrub_stamp":"2024-04-15T23:38:32.280552+0000","last_clean_scrub_stamp":"2024-04-15T23:38:32.280552+0000","objects_scrubbed":65,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T05:55:39.436588+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143791,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"79'12","reported_seq":88,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-15T23:38:26.765908+0000","last_change":"2024-04-15T23:38:26.765936+0000","last_active":"2024-04-15T23:38:26.765908+0000","last_peered":"2024-04-15T23:38:26.765908+0000","last_clean":"2024-04-15T23:38:26.765908+0000","last_became_active":"2024-04-15T23:37:54.971612+0000","last_became_peered":"2024-04-15T23:37:54.971612+0000","last_unstale":"2024-04-15T23:38:26.765908+0000","last_undegraded":"2024-04-15T23:38:26.765908+0000","last_fullsized":"2024-04-15T23:38:26.765908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'12","last_scrub_stamp":"2024-04-15T23:38:26.765822+0000","last_deep_scrub":"79'12","last_deep_scrub_stamp":"2024-04-15T23:38:26.765822+0000","last_clean_scrub_stamp":"2024-04-15T23:38:26.765822+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T03:04:28.076591+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":26580968,"num_objects":3447,"num_object_clones":0,"num_object_copies":6894,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3447,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10591,"num_write_kb":38997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3179,"num_bytes_recovered":14707475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":72867840,"data_stored":52824272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13861,"ondisk_log_size":13861,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":41596642,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":34,"num_read_kb":344,"num_write":466,"num_write_kb":41334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":17104860,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83255296,"data_stored":83193284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":74016,"internal_metadata":0},"log_size":464,"ondisk_log_size":464,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":58,"seq":249108103219,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77084,"kb_used_data":45396,"kb_used_omap":6,"kb_used_meta":31673,"kb_avail":94294756,"statfs":{"total":96636764160,"available":96557830144,"internally_reserved":0,"allocated":46485504,"data_stored":39077330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6937,"internal_metadata":32433383},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":72,"seq":309237645329,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85136,"kb_used_data":52488,"kb_used_omap":68,"kb_used_meta":32571,"kb_avail":94286704,"statfs":{"total":96636764160,"available":96549584896,"internally_reserved":0,"allocated":53747712,"data_stored":46941050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70269,"internal_metadata":33353091},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":93080,"kb_used_data":57744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94278760,"statfs":{"total":96636764160,"available":96541450240,"internally_reserved":0,"allocated":59129856,"data_stored":52181138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29380608,"data_stored":29360982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33239040,"data_stored":33208034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68674,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20635648,"data_stored":20624268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5342,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28471296,"data_stored":21896046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19230720,"data_stored":12808906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":18119320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-15T23:39:12.531 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-15T23:39:12.869 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-15T23:39:12.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:39:13.194 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:39:13.195 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T23:31:30.206590+0000","modified":"2024-04-15T23:31:32.213535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4218,"qdb_cluster":[4218]},"id":1}]} 2024-04-15T23:39:13.195 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-04-15T23:39:13.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-15T23:39:13.528 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:39:13.528 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-15T23:31:30.206590+0000","modified":"2024-04-15T23:31:32.213535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4218":{"gid":4218,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6803/1489653538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1489653538},{"type":"v1","addr":"172.21.15.102:6803","nonce":1489653538}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4218,"qdb_cluster":[4218]},"id":1}]} 2024-04-15T23:39:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-04-15T23:39:13.541 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-15T23:39:13.827 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-04-15T23:39:13.827 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":79,"fsid":"60f632e8-f087-41df-a0b6-043b99131bd6","created":"2024-04-15T23:31:15.484738+0000","modified":"2024-04-15T23:38:04.051016+0000","last_up_change":"2024-04-15T23:37:53.955442+0000","last_in_change":"2024-04-15T23:31:16.326489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-15T23:31:23.797113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-15T23:31:23.948719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-15T23:31:28.382708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-15T23:31:29.186157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37ee61ed-86ab-4308-a161-cd2aafcfd4f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6801","nonce":1269237815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6803","nonce":1269237815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6807","nonce":1269237815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":1269237815},{"type":"v1","addr":"172.21.15.107:6805","nonce":1269237815}]},"public_addr":"172.21.15.107:6801/1269237815","cluster_addr":"172.21.15.107:6803/1269237815","heartbeat_back_addr":"172.21.15.107:6807/1269237815","heartbeat_front_addr":"172.21.15.107:6805/1269237815","state":["exists","up"]},{"osd":1,"uuid":"9631dded-d96a-40ad-945d-252291b498da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":68,"up_from":72,"up_thru":72,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6801","nonce":2789808517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6803","nonce":2789808517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6807","nonce":2789808517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2789808517},{"type":"v1","addr":"172.21.15.115:6805","nonce":2789808517}]},"public_addr":"172.21.15.115:6801/2789808517","cluster_addr":"172.21.15.115:6803/2789808517","heartbeat_back_addr":"172.21.15.115:6807/2789808517","heartbeat_front_addr":"172.21.15.115:6805/2789808517","state":["exists","up"]},{"osd":2,"uuid":"45415c3c-3208-4cab-b6d2-75f250746bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":23,"up_from":58,"up_thru":72,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6801","nonce":3430252970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6803","nonce":3430252970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6807","nonce":3430252970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3430252970},{"type":"v1","addr":"172.21.15.195:6805","nonce":3430252970}]},"public_addr":"172.21.15.195:6801/3430252970","cluster_addr":"172.21.15.195:6803/3430252970","heartbeat_back_addr":"172.21.15.195:6807/3430252970","heartbeat_front_addr":"172.21.15.195:6805/3430252970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.385592+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.370073+0000","dead_epoch":68},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-15T23:31:21.369726+0000","dead_epoch":23}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-15T23:39:13.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-15T23:39:14.173 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-15T23:39:14.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-15T23:39:14.207 INFO:tasks.ceph.mds.a.smithi102.stdout:starting mds.a at 2024-04-15T23:39:15.189 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-15T23:39:16.186 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2024-04-15T23:39:16.202 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-15T23:39:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2024-04-15T23:39:17.201 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-15T23:39:17.201 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-15T23:39:17.202 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.211 INFO:tasks.ceph.mds.a:Stopped 2024-04-15T23:39:17.211 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-15T23:39:17.211 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-15T23:39:17.212 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.247 INFO:tasks.ceph.osd.0:Stopped 2024-04-15T23:39:17.248 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-15T23:39:17.248 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.279 INFO:tasks.ceph.osd.1:Stopped 2024-04-15T23:39:17.279 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-15T23:39:17.279 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.312 INFO:tasks.ceph.osd.2:Stopped 2024-04-15T23:39:17.312 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-15T23:39:17.313 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-15T23:39:17.313 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.343 INFO:tasks.ceph.mgr.x:Stopped 2024-04-15T23:39:17.343 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-15T23:39:17.343 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.411 INFO:tasks.ceph.mgr.y:Stopped 2024-04-15T23:39:17.412 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-15T23:39:17.413 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-15T23:39:17.413 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.465 INFO:tasks.ceph.mon.a:Stopped 2024-04-15T23:39:17.465 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-15T23:39:17.465 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.519 INFO:tasks.ceph.mon.b:Stopped 2024-04-15T23:39:17.519 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-15T23:39:17.519 INFO:teuthology.orchestra.run:waiting for 300 2024-04-15T23:39:17.571 INFO:tasks.ceph.mon.c:Stopped 2024-04-15T23:39:17.571 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-15T23:39:17.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-15T23:39:17.648 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi107.front.sepia.ceph.com 2024-04-15T23:39:17.648 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-15T23:39:17.791 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:39:17.791 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-15T23:39:17.949 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:39:17.950 DEBUG:teuthology.orchestra.run.smithi195:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-15T23:39:18.076 INFO:tasks.ceph:Archiving mon data... 2024-04-15T23:39:18.077 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/data/mon.a.tgz 2024-04-15T23:39:18.077 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-15T23:39:18.096 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.pdDddur4Xc 2024-04-15T23:39:18.096 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pdDddur4Xc 2024-04-15T23:39:18.271 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.pdDddur4Xc 2024-04-15T23:39:18.359 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.pdDddur4Xc is 419KB 2024-04-15T23:39:18.461 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.pdDddur4Xc 2024-04-15T23:39:18.476 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/data/mon.b.tgz 2024-04-15T23:39:18.476 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-15T23:39:18.530 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.RiRQho437l 2024-04-15T23:39:18.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RiRQho437l 2024-04-15T23:39:18.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.RiRQho437l 2024-04-15T23:39:18.802 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.RiRQho437l is 576KB 2024-04-15T23:39:18.903 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.RiRQho437l 2024-04-15T23:39:18.920 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/data/mon.c.tgz 2024-04-15T23:39:18.920 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-04-15T23:39:18.973 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.VAFfVljdRs 2024-04-15T23:39:18.974 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VAFfVljdRs 2024-04-15T23:39:19.160 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.VAFfVljdRs 2024-04-15T23:39:19.249 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.VAFfVljdRs is 576KB 2024-04-15T23:39:19.352 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.VAFfVljdRs 2024-04-15T23:39:19.367 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-15T23:39:19.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T23:39:19.409 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T23:39:19.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T23:39:19.414 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-15T23:39:19.566 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T23:39:19.583 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T23:39:19.601 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T23:39:19.628 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-15T23:39:19.629 INFO:tasks.ceph:Archiving crash dumps... 2024-04-15T23:39:19.630 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi102/crash 2024-04-15T23:39:19.631 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T23:39:19.659 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi107/crash 2024-04-15T23:39:19.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T23:39:19.821 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi115/crash 2024-04-15T23:39:19.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T23:39:19.866 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi195/crash 2024-04-15T23:39:19.867 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-15T23:39:19.906 INFO:tasks.ceph:Compressing logs... 2024-04-15T23:39:19.906 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T23:39:19.909 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T23:39:19.912 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T23:39:19.915 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-15T23:39:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46362.log 2024-04-15T23:39:19.935 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2024-04-15T23:39:19.944 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-15T23:39:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.793.log 2024-04-15T23:39:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-15T23:39:19.945 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.793.log.gz 2024-04-15T23:39:20.004 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31856.log 2024-04-15T23:39:20.005 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.788.log 2024-04-15T23:39:20.005 INFO:teuthology.orchestra.run.smithi195.stderr:gzip/var/log/ceph/ceph-client.admin.31856.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-04-15T23:39:20.005 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31856.log.gz 2024-04-15T23:39:20.005 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-15T23:39:20.005 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.788.log.gz 2024-04-15T23:39:20.005 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-client.admin.31936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31896.log 2024-04-15T23:39:20.006 INFO:teuthology.orchestra.run.smithi195.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-04-15T23:39:20.006 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.31896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31896.log.gz 2024-04-15T23:39:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33094.log 2024-04-15T23:39:20.026 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46362.log.gz 2024-04-15T23:39:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32254.log 2024-04-15T23:39:20.026 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2024-04-15T23:39:20.026 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31069.log 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33094.log.gz 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32842.log 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32254.log.gz 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31523.log 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31069.log.gz 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36087.log 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32842.log.gz 2024-04-15T23:39:20.027 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46278.log 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31523.log.gz 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34994.log 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36087.log.gz 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46278.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46278.log.gz 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47202.log 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34994.log.gz 2024-04-15T23:39:20.028 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45171.log 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36435.log 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45171.log.gz 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-04-15T23:39:20.029 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36435.log.gz 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42564.log 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35171.log 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2024-04-15T23:39:20.030 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42564.log.gz 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35171.log.gz 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38380.log 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31013.log 2024-04-15T23:39:20.031 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35394.log 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38380.log.gz 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45713.log 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31013.log.gz 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32376.log 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35394.log.gz 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32926.log 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45713.log.gz 2024-04-15T23:39:20.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32086.log 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32376.log.gz 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32926.log.gz 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39897.log 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32086.log.gz 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31439.log 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45444.log 2024-04-15T23:39:20.033 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39897.log.gz 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46146.log 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31439.log.gz 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47328.log 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45444.log.gz 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37348.log 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46146.log.gz 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2024-04-15T23:39:20.034 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47328.log.gz 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45402.log 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37348.log.gz 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33178.log 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36916.log 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45402.log.gz 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-04-15T23:39:20.035 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36916.log.gz 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35789.log 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47034.log 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35789.log.gz 2024-04-15T23:39:20.036 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34209.log 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47034.log.gz 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34510.log 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.34209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35702.log 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr: 32.1% -- replaced with /var/log/ceph/ceph-client.0.34209.log.gz 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32504.log 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34510.log.gz 2024-04-15T23:39:20.037 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37261.log 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35702.log.gz 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47454.log 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32504.log.gz 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34950.log 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37261.log.gz 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.47454.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45936.log 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47454.log.gz 2024-04-15T23:39:20.038 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46062.log 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34950.log.gz 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34910.log 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45936.log.gz 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46062.log.gz 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30849.log 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31113.log 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34910.log.gz 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37694.log 2024-04-15T23:39:20.039 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30849.log.gz 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37393.log 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31113.log.gz 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37694.log.gz 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32377.log 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37393.log.gz 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37003.log 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-04-15T23:39:20.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46446.log 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32377.log.gz 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31481.log 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37003.log.gz 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36178.log 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46446.log.gz 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31481.log.gz 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31960.log 2024-04-15T23:39:20.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36178.log.gz 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47160.log 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31960.log.gz 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35041.log 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47160.log.gz 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-04-15T23:39:20.042 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35041.log.gz 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39024.log 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37874.log 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-04-15T23:39:20.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42411.log 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39024.log.gz 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31704.log 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37874.log.gz 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42411.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42411.log.gz 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32968.log 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31704.log.gz 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-04-15T23:39:20.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32968.log.gz 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41123.log 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33782.log: /var/log/ceph/ceph-client.admin.47370.log 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.41123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41123.log.gz 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36697.log 2024-04-15T23:39:20.045 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47370.log.gz 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33676.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz -- 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.35353.log 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36697.log.gz 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45318.log 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35353.log.gz 2024-04-15T23:39:20.046 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30639.log 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45318.log.gz 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47076.log 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37129.log 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30639.log.gz 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34468.log 2024-04-15T23:39:20.047 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47076.log.gz 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33428.log 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37129.log.gz 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35875.log 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34468.log.gz 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35082.log 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33428.log.gz 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46652.log 2024-04-15T23:39:20.048 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35875.log.gz 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37747.log 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35082.log.gz 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46652.log.gz 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37747.log.gz 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-04-15T23:39:20.049 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30872.log 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.30872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36394.log 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30872.log.gz 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37043.log 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-04-15T23:39:20.050 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38006.log 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36394.log.gz 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46188.log 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37043.log.gz 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38006.log.gz 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33386.log 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46188.log.gz 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31175.log 2024-04-15T23:39:20.051 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33386.log.gz 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31175.log.gz 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37174.log 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz 2024-04-15T23:39:20.052 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36219.log 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34819.log 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37174.log.gz 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36219.log.gz 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34819.log.gz 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47412.log 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-04-15T23:39:20.053 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33136.log 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47412.log.gz 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35485.log 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35219.log 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33136.log.gz 2024-04-15T23:39:20.054 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32002.log 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35485.log.gz 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47833.log 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35219.log.gz 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42984.log 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32002.log.gz 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45360.log 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47833.log.gz 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.42984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32170.log 2024-04-15T23:39:20.055 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42984.log.gz 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38069.log 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45360.log.gz 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32170.log.gz 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35613.log 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37605.log 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38069.log.gz 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40225.log 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35613.log.gz 2024-04-15T23:39:20.056 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37605.log.gz 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.40225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40225.log.gz 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47244.log 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2024-04-15T23:39:20.057 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47244.log.gz 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34730.log 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34730.log.gz 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-04-15T23:39:20.058 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32632.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29781.log 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46866.log 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.tmp-client.admin.29781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46572.log 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29781.log.gz 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36262.log 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46866.log.gz 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47623.log 2024-04-15T23:39:20.059 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46572.log.gz 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36262.log.gz 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32212.log 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47623.log.gz 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46231.log 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32212.log.gz 2024-04-15T23:39:20.060 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46231.log.gz 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32296.log 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32296.log.gz 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33304.log 2024-04-15T23:39:20.061 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46104.log 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37214.log 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr: 49.5% -- replaced with /var/log/ceph/ceph-client.admin.33304.log.gz 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45978.log 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46104.log.gz 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31565.log 2024-04-15T23:39:20.062 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37214.log.gz 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31609.log 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45978.log.gz 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48020.log 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31565.log.gz 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47749.log 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31609.log.gz 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.48020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31876.log 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48020.log.gz 2024-04-15T23:39:20.063 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37834.log 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47749.log.gz 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45852.log 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31876.log.gz 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37834.log.gz 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32716.log 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45852.log.gz 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34598.log 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2024-04-15T23:39:20.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32716.log.gz 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45671.log 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38643.log 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34598.log.gz 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31918.log 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45671.log.gz 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.38643.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38643.log.gz 2024-04-15T23:39:20.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37434.log 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31918.log.gz 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31355.log 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37434.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37434.log.gz 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31355.log.gz 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34332.log 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-04-15T23:39:20.066 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45234.log 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34332.log.gz 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45234.log.gz 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31788.log 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31746.log 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-04-15T23:39:20.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31788.log.gz 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35572.log 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47496.log 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31746.log.gz 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33010.log 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35572.log.gz 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47496.log.gz 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36784.log 2024-04-15T23:39:20.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33010.log.gz 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36825.log 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36784.log.gz 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36825.log.gz 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31834.log 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31653.log 2024-04-15T23:39:20.069 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31834.log.gz 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31653.log.gz 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46488.log 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47538.log 2024-04-15T23:39:20.070 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46488.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46488.log.gz -5 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36005.log 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47538.log.gz 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36005.log.gz 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2024-04-15T23:39:20.071 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46992.log 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46992.log.gz 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33675.log 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33512.log 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33675.log.gz 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-15T23:39:20.072 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33512.log.gz 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31247.log 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46740.log 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31247.log.gz 2024-04-15T23:39:20.073 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47118.log 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46740.log.gz 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32378.log 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35660.log 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47118.log.gz 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32378.log.gz 2024-04-15T23:39:20.074 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32758.log 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47286.log 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35660.log: 95.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35660.log.gz 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47978.log 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32758.log.gz 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/ceph-client.admin.47286.log: -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47286.log.gz 2024-04-15T23:39:20.075 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34864.log 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47978.log.gz 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32128.log 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47707.log 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34864.log.gz 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32128.log.gz 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31300.log 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47707.log.gz 2024-04-15T23:39:20.076 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35527.log 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34690.log 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31300.log.gz 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46530.log 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35527.log.gz 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.34690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34690.log.gz 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2024-04-15T23:39:20.077 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46530.log.gz 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.45756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32503.log 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37789.log 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.47791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.32503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31397.log 2024-04-15T23:39:20.078 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32503.log.gz 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37789.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.33574.log -- replaced with /var/log/ceph/ceph-client.admin.37789.log.gz 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31397.log.gz 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46320.log 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.46320.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46320.log.gz 2024-04-15T23:39:20.079 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.admin.35937.log 2024-04-15T23:39:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.33470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-04-15T23:39:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36323.log 2024-04-15T23:39:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35937.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-15T23:39:20.080 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35937.log.gz 2024-04-15T23:39:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36323.log.gz 2024-04-15T23:39:20.080 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-15T23:39:20.081 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-15T23:39:20.128 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-15T23:39:20.171 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-15T23:39:20.239 INFO:teuthology.orchestra.run.smithi102.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-15T23:39:20.241 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-04-15T23:39:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m0.319s 2024-04-15T23:39:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m0.745s 2024-04-15T23:39:20.242 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.139s 2024-04-15T23:39:21.099 INFO:teuthology.orchestra.run.smithi195.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-15T23:39:21.101 INFO:teuthology.orchestra.run.smithi195.stderr: 2024-04-15T23:39:21.101 INFO:teuthology.orchestra.run.smithi195.stderr:real 0m1.136s 2024-04-15T23:39:21.101 INFO:teuthology.orchestra.run.smithi195.stderr:user 0m1.043s 2024-04-15T23:39:21.101 INFO:teuthology.orchestra.run.smithi195.stderr:sys 0m0.064s 2024-04-15T23:39:22.594 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.0.log: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-15T23:39:22.596 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-04-15T23:39:22.596 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m2.669s 2024-04-15T23:39:22.596 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m2.576s 2024-04-15T23:39:22.596 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.103s 2024-04-15T23:39:22.729 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.1.log: 94.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-15T23:39:22.731 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-04-15T23:39:22.731 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m2.802s 2024-04-15T23:39:22.731 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m2.566s 2024-04-15T23:39:22.731 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m0.113s 2024-04-15T23:39:22.732 INFO:tasks.ceph:Archiving logs... 2024-04-15T23:39:22.732 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi102/log 2024-04-15T23:39:22.733 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T23:39:23.085 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi107/log 2024-04-15T23:39:23.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T23:39:23.507 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi115/log 2024-04-15T23:39:23.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T23:39:23.923 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi195/log 2024-04-15T23:39:23.924 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-15T23:39:24.111 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-15T23:39:24.122 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-15T23:39:24.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T23:39:24.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T23:39:24.128 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T23:39:24.131 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-15T23:39:24.261 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-15T23:39:24.270 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-15T23:39:24.270 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:39:24.273 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:39:24.275 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:39:24.278 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-15T23:39:24.287 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:39:24.290 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:39:24.291 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:39:24.292 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-04-15T23:39:24.292 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +692us[ +687us] +/- 41ms 2024-04-15T23:39:24.292 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1020us[-1025us] +/- 71ms 2024-04-15T23:39:24.292 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -71us[ -75us] +/- 86ms 2024-04-15T23:39:24.292 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:39:24.293 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:39:24.293 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-04-15T23:39:24.294 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:39:24.294 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-04-15T23:39:24.295 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +725us[ +731us] +/- 41ms 2024-04-15T23:39:24.295 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1027us[-1021us] +/- 71ms 2024-04-15T23:39:24.295 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -54us[ -54us] +/- 86ms 2024-04-15T23:39:24.295 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:39:24.297 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:39:24.297 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-04-15T23:39:24.297 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 37 36 +573us[ +737us] +/- 41ms 2024-04-15T23:39:24.298 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 37 36 -1164us[-1164us] +/- 71ms 2024-04-15T23:39:24.298 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 37 36 -185us[ -185us] +/- 86ms 2024-04-15T23:39:24.298 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:39:24.299 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-15T23:39:24.299 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-04-15T23:39:24.300 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +659us[ +660us] +/- 41ms 2024-04-15T23:39:24.300 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -1085us[-1084us] +/- 71ms 2024-04-15T23:39:24.300 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -71us[ -71us] +/- 86ms 2024-04-15T23:39:24.300 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-15T23:39:24.300 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-15T23:39:24.311 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-15T23:39:24.312 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-15T23:39:24.326 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T23:39:24.409 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T23:39:24.486 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T23:39:24.635 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-15T23:39:24.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:39:24.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:24.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:39:24.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:24.824 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:39:24.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:24.862 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-15T23:39:24.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:24.896 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-15T23:39:24.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-15T23:39:24.916 INFO:teuthology.task.internal:Duration was 894.704477 seconds 2024-04-15T23:39:24.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-15T23:39:24.927 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-15T23:39:24.927 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T23:39:24.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T23:39:24.932 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T23:39:24.934 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-15T23:39:24.976 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:39:24.978 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:39:25.005 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:39:25.013 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-15T23:39:25.304 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-15T23:39:25.304 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-04-15T23:39:25.304 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T23:39:25.326 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-04-15T23:39:25.326 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T23:39:25.348 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-04-15T23:39:25.348 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T23:39:25.382 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2024-04-15T23:39:25.382 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-15T23:39:25.418 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-15T23:39:25.418 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T23:39:25.421 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T23:39:25.423 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T23:39:25.425 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-15T23:39:25.489 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-15T23:39:25.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T23:39:25.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T23:39:25.495 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T23:39:25.497 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-15T23:39:25.598 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-15T23:39:25.610 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-15T23:39:25.610 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T23:39:25.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T23:39:25.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T23:39:25.699 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-15T23:39:25.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-15T23:39:25.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.742 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.746 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.766 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-04-15T23:39:25.768 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-04-15T23:39:25.787 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-04-15T23:39:25.807 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2024-04-15T23:39:25.839 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:25.854 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:25.869 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:25.885 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-15T23:39:25.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-15T23:39:25.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-15T23:39:25.911 INFO:teuthology.task.internal:Transferring archived files... 2024-04-15T23:39:25.911 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi102 2024-04-15T23:39:25.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T23:39:25.950 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi107 2024-04-15T23:39:25.950 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T23:39:25.988 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi115 2024-04-15T23:39:25.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T23:39:26.024 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659/remote/smithi195 2024-04-15T23:39:26.024 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-15T23:39:26.058 INFO:teuthology.task.internal:Removing archive directory... 2024-04-15T23:39:26.059 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T23:39:26.061 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T23:39:26.063 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T23:39:26.066 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-15T23:39:26.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-15T23:39:26.122 INFO:teuthology.task.internal:Not uploading archives. 2024-04-15T23:39:26.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-15T23:39:26.132 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-15T23:39:26.133 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T23:39:26.135 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T23:39:26.137 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T23:39:26.139 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-15T23:39:26.147 INFO:teuthology.orchestra.run.smithi102.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 23:39 /home/ubuntu/cephtest 2024-04-15T23:39:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 23:39 /home/ubuntu/cephtest 2024-04-15T23:39:26.152 INFO:teuthology.orchestra.run.smithi115.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 23:39 /home/ubuntu/cephtest 2024-04-15T23:39:26.166 INFO:teuthology.orchestra.run.smithi195.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 15 23:39 /home/ubuntu/cephtest 2024-04-15T23:39:26.167 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-15T23:39:26.179 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-15T23:39:26.204 INFO:teuthology.nuke:Checking targets against current locks 2024-04-15T23:39:26.230 DEBUG:teuthology.nuke:shortname: smithi102 2024-04-15T23:39:26.230 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T23:39:26.255 DEBUG:teuthology.nuke:shortname: smithi107 2024-04-15T23:39:26.255 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T23:39:26.261 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.727841', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLN/72GoCFriHKlyrdZVw/LdEz3dUx834w+2cx7NLTjKBrEAny5jo1VZjCXTQVczjIyQj4AOA8O4CKiRShUQUP4='} 2024-04-15T23:39:26.278 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.729191', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE8e3tEe5X1UTLxmj184KS+lctC4v2gex0rXpKXUJRBdtcmBrNXDrQ7e5abae1crWzMM2UHTIjrNUET0OQwgP1A='} 2024-04-15T23:39:26.282 DEBUG:teuthology.nuke:shortname: smithi115 2024-04-15T23:39:26.282 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T23:39:26.313 INFO:teuthology.orchestra.console.smithi102:Power off 2024-04-15T23:39:26.313 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T23:39:26.324 DEBUG:teuthology.nuke:shortname: smithi195 2024-04-15T23:39:26.325 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-15T23:39:26.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.731614', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKJ/VR8YskKUNlKlpbgC+MoDBAX2u4amTrTWtQwffLPPh/IsGUxNqXxAVpHebJXumOEQvPg5atV+2C5TG3gLIXM='} 2024-04-15T23:39:26.337 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-04-15T23:39:26.337 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:26.357 INFO:teuthology.orchestra.console.smithi107:Power off 2024-04-15T23:39:26.357 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T23:39:26.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-15_21:32:02-powercycle-squid-distro-default-smithi/7657659', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-15 23:15:49.730406', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBXzIbTpoWupgp/B0wH0rH2O3cg7qAhRffdOCdtmffkpk4nUbuq/DrP1ZSYMFh7nztFVRyBxY4mtGqQ+mZ/hLhY='} 2024-04-15T23:39:26.376 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-15T23:39:26.385 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-04-15T23:39:26.385 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:26.409 INFO:teuthology.orchestra.console.smithi115:Power off 2024-04-15T23:39:26.410 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T23:39:26.421 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-04-15T23:39:26.436 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-04-15T23:39:26.436 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:26.456 INFO:teuthology.orchestra.console.smithi195:Power off 2024-04-15T23:39:26.457 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T23:39:26.468 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:39:26.480 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-04-15T23:39:26.480 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:26.504 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-15T23:39:30.377 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:30.423 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:30.469 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:30.489 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-15T23:39:30.505 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:30.534 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-04-15T23:39:30.580 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:39:30.616 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-04-15T23:39:34.492 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:34.535 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:34.581 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:34.603 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-04-15T23:39:34.617 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:34.646 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-04-15T23:39:34.693 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-15T23:39:34.729 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-04-15T23:39:34.830 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-04-15T23:39:38.606 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:38.648 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:38.695 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T23:39:38.717 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-04-15T23:39:38.759 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-04-15T23:39:38.807 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-15T23:39:38.818 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-04-15T23:39:38.860 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-04-15T23:39:38.907 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-04-15T23:39:39.014 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} duration: 894.7044770717621 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi102 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=461a84e6fbbf089011eafd13b98169fb9e9b8cc9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d56dcf190b424200972d8a716d4e4f69 status: fail success: false 2024-04-15T23:39:39.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T23:39:39.101 INFO:teuthology.run:FAIL